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FOREWORD 


We  are  indebted  to  Dr.  James  S.  Roach  for  the  pilot  study  which  suggested  the  possibility 
of  applying  content  analysis  to  Section  V  of  officer  effectiveness  reports.  Working  with  instructor 
OERs  at  Air  University,  he  found  qualitative  differences  in  a  sample  of  only  14  reports. 

After  deciding  upon  the  research,  the  team  of  Contractor  and  monitoring  personnel  encountered 
problems  which  could  be  solved  only  by  the  introduction  of  novel  methods.  One  of  these  was  the 
substitution  of  group-mean  criterion  values  for  every  level  of  a  predictor  sequence;  where  the  levels 
contained  extremely  different  frequencies,  and  where  one  of  the  level's  contained  all  cases  not 
falling  into  the  established  categories  of  the  sequence.  The  method  itself  was  suggested  by 
Dr.  Robert  Bottenberg  and  Dr.  Raymond  Christal  of  Personnel  Research  Laboratory,  and  the  cross- 
validation  test  of  its  effect  was  suggested  by  Mr.  Wallace  Knetz  of  the  American  Institute  for 
Research. 

Initially,  the  study  was  limited  to  a  regression  program  for  slower  computers,  but  was  extended 
by  Dr.  Joe  H.  Ward's  Fortran  program  adapted  to  the  IBM  7090.  Linear  regression  problems  involving 
165  variables  had  not  previously  been  attempted. 

The  study  also  grew  in  number  of  officer  records  involved.  It  represents  almost  the  entire 
population  of  Communications  Officers  on  active  duty  in  the  3034  Specialty  in  late  1958,  and  most 
of  the  R&D  officers  in  grades  of  first  lieutenant  and  captain.  Acquisition  of  these  records  in¬ 
volved  the  patient  cooperation  of  HQ  USAF  (AFCAS)  who  searched  out  the  files  and  provided 
space;  the  Air  Reserve  Records  Center,  Denver,  and  the  Federal  Personnel  Record  Center,  St. 

Louis,  who  searched  the  files  and  provided  microfilms  of  records  for  officers  not  on  active  duty. 

We  are  deeply  grateful  to  these  groups. 


LLEWELLYN  N.  WILEY 
Contract  Monitor 


ABSTRACT 

To  increase  the  amount  of  information  that  can  be  used  in  determining 
desirable  job  requirements  and  in  evaluating  officer  performance,  two  sources 
were  examined  for  pertinent  and  scalable  variables.  From  personnel  records  of 
officers  in  the  Communications  Specialty  and  the  Research  &  Development  career 
area,  76  variables  were  identified  and  scaled.  By  developing  a  method  for  content 
analysis,  information  from  the  Word  Picture  section  of  the  Officer  Effectiveness 
Reports  for  the  same  officers  was  quantified  on  89  scales.  Individual  data  records, 
score  distributions,  and  intercorrelations  of  165  variables  for  the  two  samples  are 
available  for  use  in  developing  qualifications  and  criteria  for  jobs  in  these  areas. 


This  report  has  been  reviewed  and  is  approved. 


Fred  E.  Holdrege,  Col  USAF  A.  Carp 

Commander  Technical  Director 


Hq  6570th  Personnel  Research  Laboratory 
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FEASIBILITY  OF  IDENTIFYING  PREDICTORS  OF  SUCCESS  IN  OFFICER  JOBS 
FROM  PERSONNEL  RECORDS  AND  THE  WORD  PICTURE  SECTION  OF 
EFFECTIVENESS  REPORTS 


1.  INTRODUCTION 

The  primary  purpose  of  this  study  was  to  determine  the  feasibility  of  using  information  in 
Officer  Personnel  Folders  for  identifying  variables  relevant  to  success  in  selected  Air  Force 
Officer  specialties.  Accordingly,  the  bulk  of  the  research  effort  was  devoted  to  the  development 
of  methods  for  quantifying  and  statistically  analyzing  the  large  variety  of  material  which  offered 
promise  of  being  predictive  of  officer  effectiveness.  The  purpose  of  this  report  is  to  describe  the 
methods  developed  and  to  summarize  the  chief'  results  of  the  quantitative  data  analysis,  which  was 
performed  on  a  high-speed  computer  (the  IBM  7090).  The  results  of  the  computer  runs,  together 
with  the  input  data,  constitute  a  rather  extensive  and  unique  data  bank  which  has  not  been  previ¬ 
ously  available.  It  is  anticipated  that  these  data  will  be  utilized  in  performing  more  detailed  and 
more  extensive  analyses,  depending  upon  the  specific  research  questions  of  interest  to  the  Air 
Force  in  its  personnel  operations. 


2.  SAMPLE  AND  CRITERIA 

Two  specialties  were  selected  for  study:  Communications  Officers,  constituting  a  relatively 
homogeneous  group,  and  Research  and  Development  Officers,  constituting  a  group  of  relatively 
diverse  occupations.  The  two  groups  were  also  selected  to  maximize  differences  in  education  and 
experience  factors.  The  specific  officers  to  be  included  were  selected  from  the  OER  data  bank 
(Vanasek,  1960). 

For  Communications  Officers,  the  selected  sample  consisted  of  all  men  serving  as  lieuten¬ 
ants  to  majors  with  a  duty  AFSC  of  3034  as  indicated  in  their  last  OER  in  1958.  For  R  &  D 
Officers,  the  selected  sample  consisted  of  all  men  serving  as  first  lieutenants  and  captains  with 
a  duty  AFSC  in  the  R  &  D  field  as  indicated  in  their  last  OER  in  1958. 

The  chief  criterion  of  success  as  an  officer  was  the  rating  of  "Overall  Evaluation"  contained 
in  Section  IV  of  the  USAF  Officer  Effectiveness  Report.  The  particular  OER  chosen  was  the  last 
one  completed  in  1959.  If  an  officer's  folder  did  not  contain  an  OER  completed  in  1959,  the  earliest 
one  for  1960  was  selected.  If  there  was  no  OER  completed  in  1959  or  in  1960,  the  latest  in  1958 
was  used. 

By  late  1960  and  early  1961,  when  the  data  were  collected,  many  of  the  selected  officers 
were  no  longer  on  active  duty.  The  proportion  of  men  no  longer  on  active  duty  was  considerably 
higher  in  the  R  &  D  sample  than  in  the  Communications  Officer  sample,  as  shown  below: 


Communications 

R  &D  Officers  Officers 


N 

% 

N 

% 

On  active  duty 

1284 

70.9 

1121 

93.0 

Not  on  active  duty 

528 

29.1 

84 

7.0 

Total 

1812 

100.0 

1205 

100.0 

Inasmuch  as  this  finding  was  anticipated,  the  dichotomous  measure  "on  active  duty/  not  on 
active  duty"  was  included  in  the  study  as  a  second  criterion  measure. 
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3.  PREDICTORS 


Predictors  were  derived  from  two  sources,  the  OER  itself  and  USAF  Form  11,  ''Officer 
Military  Record."  Table  1  lists  the  predictor  variables  derived  from  the  information  contained 
in  Form  11.  The  scoring  codes  for  these  variables  are  shown  in  Appendix  I. 


TABLE  1.  Predictor  Variables  Derived  from  Form  11 


Variable 

Number 

Name  of  Variable 

Vorl  able 
Number 

Name  of  Voriable 

Experience 

Education  (Cont.) 

1 

Months  in  active  commissioned  service 

20 

Level  of  education 

2 

Break  in  active  commissioned  service 

21 

Major  academic  field 

3 

Source  of  commission 

4 

Relative  speed  of  promotion 

Experience 

5 

Months  in  grade 

22 

Rating/flying  status/jet  qualification 

6 

Months  overseas  as  an  officer 

23 

Total  flying  hours 

7 

Overseas  service  as  officer 

Personal 

8 

Months  in  field 

Character- 

9 

Duty  not  in  primary  field 

istics 

10 

Number  of  AFSCs  held 

24 

11 

Number  of  assignments  in  field 

25 

Grade 

12 

Average  responsibility  level 

26 

Security  clearance  level 

13 

Combat  experience 

27 

Marital  status 

14 

Highest  enlisted  rank 

26 

Religion 

15 

No  enlisted  service 

29 

Race 

16 

Component  —  Regular  Officer 

3<> 

Career  preference 

17 

Component  —  Reserve  Officer 

31 

Command  preference 

Education 

32 

School  preference 

18 

Number  of  service  school  courses 

33 

Next  assignment  preference 

19 

Highest  career  school 

34 

Awards  (dated  1952  and  later) 

The  predictor  variables  derived  from  the  OER  consisted  of  factual  items,  subscale  ratings, 
and  variables  generated  through  content  analysis  of  Section  V,  the  so-called  "word-picture." 
The  non-content  OER  variables  are  shown  in  Table  2.  Scoring  codes  are  shown  in  Appendix  1. 
The  content-analysis  variables  are  listed  in  Appendix  II. 


TABLE  2.  Non-Content  OER  Variables 


Variable 

Number 

Name  of  Vorioble 

Vari  oble 
Number 

Name  of  Variable 

35 

Coded  duty  AFSC 

48 

Number  of  additional  factors  rated 

36 

Command  (OER) 

49 

Unique  factor  rated  (factor  other  than 

37 

Civilian  rater 

those  contained  in  variables  50-54) 

38 

Rater  grade 

50 

Responsibility  score 

39 

Relative  level  of  rater 

51 

Initiative  score 

40 

Overall  effectiveness,  OER  (criterion 

52 

Adaptability  score 

score) 

53 

Creativity  score 

41 

Subscale  1  —  Job  knowledge 

54 

Reaction  to  stress  score 

42 

Subscale  2  —  Cooperation 

55 

Responsibility  not  rated 

43 

Subscale  3— Judgment 

56 

Initiative  not  rated 

44 

Subscale  4— Management  qualities 

57 

Adaptability  not  rated 

45 

Subscale  5  —  Leadership 

58 

Creativity  not  rated 

46 

Subscole  6  —  Communication  facility 

59 

Reaction  to  stress  not  rated 

47 

Subscale  7  — Promotion  potential 
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4.  PROCEDURES 


DATA  ACQUISITION 

From  the  Officer  Personnel  Folders,  the  Form  11  and  all  OERs  and  Training  Reports  from 
the  most  recent  found  to  the  earliest  in  1957  were  photographed,  using  a  flat-bed  microfilm 
camera.  Although  only  one  OER  per  officer  would  be  used  for  analysis,  the  others  were  photo¬ 
graphed  since  with  no  appreciable  increase  in  effort  a  comprehensive  set  of  data  for  possible 
future  analysis  could  be  developed.^  In  addition,  the  Commendations  section  of  each  folder  was 
searched  and  a  list  was  compiled,  by  officer,  of  all  awards  and  other  commendations  and  the  date 
each  was  received. 

Information  needed  for  Form  11  variables  v;as  tabulated  directly  from  the  microfilm  and  coded 
later.  A  microfilm  reader-printer  was  used  and  a  print  of  the  OER  selected  for  analysis  was  made 
at  the  same  time  as  the  Form  11  information  was  tabulated.  Content  analysis  and  tabulation  of 
other  OER  data  was  done  from  prints. 

DATA  SELECTION 

The  Form  11  variables  and  the  non-content  OER  variables  were  selected  through  conferences 
between  the  research  staff  and  Air  F'orce  representatives.  Wherever  possible,  codes  were  chosen 
for  compatability  with  Air  Force  codes.'  Several  of  the  variables  were  generated  from  the  raw  data 
contained  in  Form  11.  These  are  shown  and  defined  in  Table  3. 


TABLE  3.  Variables  Generated  from  Form  11  Data 


} 

Variable 

Humber 

Home  of  Variable 

Definition 

1 

Months  in  active  commissioned 
service 

OER  date  minus  Total  Active  Federal 

Commissioned  Service  Date  (TAFCSD). 

2 

Break  in  active  commissioned 

service 

Date  of  Extended  Active  Duty  (EAD) 
minus  TAFCSD. 

4 

Relative  speed  of  promotion 

Date  of  highest  temporary  grade  minus 
TAFCSD. 

5 

Months  in  grade 

OER  date  minus  date  of  highest  temporary 
grade. 

8 

Months  in  field 

OER  date  minus  earliest  date  of  AFSC  with 
same  first  2  digits  as  Duty  AFSC  on  OER 

9 

Duty  not  in  primary  field 

Comparison  between  Duty  AFSC  on  OER 
and  Primary  AFSC,  using  first  3  digits 
of  each. 

12 

Average  responsibility  level 

Mean  responsibility  score  for  assignments 
in  field  as  recorded  in  Item  19  of  Form 

11.  Responsibility  scale  is  shown  in 
Appendix  III. 

24 

Age  in  years 

OER  date  minus  date  of  birth. 

^  Microfilm  data  are  available  on  loan  to  qualified  requesters  from  6V50th  Personnel 
Research  Laboratory  (PRB),  Lackland  AFB,  Tex. 
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The  OER  date  referred  to  in  Table  3  is  the  date  of  the  close  of  the  period  covered  by  the 
OER  selected  for  study.  This  date  was  used  as  the  cutoff  point  for  all  Form  11  variables  which 
were  dated.  For  example,  in  tabulating  months  overseas,  an  officer  was  not  credited  with  over¬ 
seas  time  beyond  the  OER  dale,  and  in  counting  the  number  of  AFSCs  held,  no  AFSC  was  counted 
if  it  was  dated  beyond  the  OER  date, 

CONTENT  ANALYSIS 

The  development  of  categories  for  classifying  the  information  in  Section  V  of  the  OER  was 
accomplished  on  a  logical-empirical  basis.  As  the  first  step,  a  sample  of  20  records  was  screened 
for  all  "bits''  of  inforrhation.  A  "bit"  was  defined  as  a  word  or  phrase  which  tells  something 
about  the  performance  of  the  ratee.  It  may  have  been  a  trait  or  other  attribute,  such  as  "good 
judgment"  or  "pleasing  personality",  or  a  description  of  an  accomplishment,  such  as  "briefed 
the  commanding  officer,"  or  "developed  a  plan  for  gathering  information  systematically."  Specifi¬ 
cally  excluded  from  consideration  were  phrases  which  duplicated  or  expanded  upon  the  job  descrip¬ 
tion  contained  in  Section  II  of  the  OER  with  no  further  indication  of  the  ratee's  performance,  and 
phrases  which  described  the  task  or  mission  of  the  rater's  organization.  The  20  records  yielded 
approximately  500  bits  of  information. 

It  was  recognized  that  there  were  two  chief  dangers  inherent  in  any  content-analysis  system. 
On  the  one  hand,  one  can  use  relatively  few  categories,  defined  in  relatively  abstract  terms,  and 
force  the  analyst  to  "read  in"  meanings  in  order  to  decide  on  the  appropriate  category.  On  the 
other  hand,  one  may  reduce  the  "read  in' '  or  second-guess  danger  by  having  many  categories, 
each  of  which  is  fairly  concrete  or  explicit.  This  approach  runs  the  risk  of  developing  so  large  a 
set  of  "objective"  categories  that  there  will  be  few  entries  in  each  and  statistical  analysis  would 
be  very  cumbersome  or  in  some  cases  even  impossible.  It  was  decided  that  in  the  initial  stages 
of  category  development,  many  highly-specific  categories  would  be  preferable  to  few  abstract 
categories,  and  that  adjustments  in  the  number  of  categories  could  be  made  at  a  subsequent  stage. 

Each  bit  was  put  on  a  separate  slip  of  paper  and  the  slips  were  sorted  first  into  two  gross 
categories:  ratee  acts,  and  rater  judgments.  The  bits  within  each  category  were  then  sorted  for 
similarity,  primarily  on  d  semantic  basis.  Two  bits  were  considered  different  if  their  words  were 
not  clearly  synonomous,  even  though  the  two  bits  were  cited  together  and  are  frequently  found 
together.  For  example,  "mature"  and  "works  well  under  stress"  were  considered  to  be  different 
at  this  stage  of  the  analysis,  while  "hard-working"  and  "industrious"  were  considered  to  be 
synonymous.  In  searching  for  similarities,  and  in  all  subsequent  content  analysis,  classifications 
were  decided  using  a  "usage"  frame  of  reference  rather  than  a  "dictionary"  point  of  view.  Doubt¬ 
ful  cases  were  decided  by  asking,  "What  is  the  rater  most  likely  trying  to  say  with  this  phrase  or 
word?"  rather  than  by  asking,  "What  does  this  word  actually  mean?" 

The  first  set  of  categories  developed  for  rater  judgments  was  tested  by  having  three  judges 
independently  sort  approximately  400  of  the  information  bits.  For  45  percent  of  the  bits,  there 
was  unanimous  agreement  on  the  appropriate  category.  For  another  40  percent  of  the  bits  there 
was  agreement  by  two  out  of  the  three  judges.  While  these  results  were  encouraging,  of  greater 
importance  at  this  stage  of  the  study  was  the  opportunity  to  identify  ambiguities,  overlaps,  and 
inconsistencies  in  the  category  system  by  analyzing  the  disagreements  and  by  discussing  the 
problem  with  the  participating  judges.  Revisions  could  then  be  made  in  the  system  and  the 
statements  were  re-sorted.  A  new  sample  of  bits  was  then  drawn  from  the  records  of  20  more 
officers  and  these  bits  were  sorted  into  the  existing  categories,  with  new  categories  added  as 
needed.  In  this  revision,  an  attempt  was  made  to  group  several  specific  categories  into  somewhat 
larger  categories  in  anticipation  of  a  future  need  to  reduce  the  total  number  of  distinct  categories. 
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Approximately  525  statements  from  the  second  sample  were  sorted  by  two  judges  independ¬ 
ently  using  the  second  set  of  categories.  The  two  judges  agreed  on  82  percent  of  the  statements, 
and  for  an  additional  7  percent  there  was  agreement  with  respect  to  the  next  larger  category. 

Again,  analysis  and  discussion  identified  sources  of  disagreement  and  a  third  revision  was  made. 

Concurrent  with  the  above  efforts,  attention  was  given  to  the  problem  of  specificity  of  the 
citation,  the  problem  of  "frequency-of-mention"  of  a  category,  and  the  problem  of  scaling  within 
a  category. 

The  specificity  problem  refers  to  the  fact  that  a  citation  of  given  attribute,  e.g.,  "judgment," 
can  refer  to  one  of  three  degrees  of  specificity,  as  follows: 

a)  concrete  example:  "Captain  X  showed  good  judgment  in  modifying  the  lighting 

system  in  the  teletype  area." 

b)  general  statement:  "Captain  X  has  good  judgment." 

c)  statement  of  consistency:  "Captain  X  always  shows  good  judgment." 

An  attempt  was  made  early  in  the  study  to  preserve  these  distinctions.  However,  since  the  number 
of  categories  was  quite  large,  and  since  the  "always"  type  of  statement  was  relatively  rare,  it 
was  decided  that  only  the  distinction  between  concrete  example  and  general  statement  would  be 
kept,  with  the  "always"  statement  absorbed  in  the  general  statement.  Categories  were  reduced 
further  by  eliminating  the  concrete  example  rubric  for  categories  in  which  examples  were  rarely 
cited,  such  as  "dependable"  or  "mature." 

The  "frequency-of-mention"  problem  refers  to  the  fact  that  in  many  cases  an  attribute  is 
cited  several  times  in  one  OER.  This  may  mean  either  that  the  rater  is  more  impressed  with  this 
attribute  than  one  citation  would  indicate,  or  that  the  rater  writes  in  a  careless  or  repetitious 
fashion.  Early  in  the  study,  an  attempt  was  made  to  preserve  frequency-of-mention  of  a  category 
as  a  separate  variable.  When  the  need  arose  to  curtail  the  number  of  variables,  the  frequency-of- 
mention  concept  was  absorbed  in  the  scaling  system,  as  explained  below. 

The  first  attempt  at  scaling  within  a  category  allowed  for  four  degrees  of  quality  for  positive 
or  favorable  mentions,  and  two  degrees  for  negative  or  unfavorable  mentions. 

The  six-point  scale  used  was  as  follows: 

0  — a  strong  negative  statement 

1  — a  mildly  negative  statement 

4  — an  unelaborated  statement,  e.g.,  "showed  logical  thinking" 

5  — a  mildly  elaborated  statement,  e.g.,  "very  logical  thinking,"  "analytical 

thinking  is  his  strong  point" 

8  — a  strongly  elaborated  statement,  e.g.,  "one  of  the  most  logical  thinkers  I 

know" 

9  — very  strongly  elaborated  statement,  e.g.,  "undoubtedly  the  best  logical 

thinker  Rve  ever  known" 

It  was  subsequently  found  necessary  to  add  another  step  between  the  mildly  elaborated 
statement  and  the  strongly  elaborated  statement,  since  many  statements  were  found  which  did  not 
belong  in  step  5  and  were  not  strong  enough  for  step  8.  It  was  also  decided  that  frequency-of- 
mention  would  be  absorbed  in  the  qualitative  scale  since  the  total  number  of  variables  had  to  be 
reduced  and  frequency  was  not  showing  sufficient  variance  to  be  of  value  as  a  separate  variable. 
The  9-step  scale  developed  to  combine  quality  and  frequency  of  mention  is  shown  below: 
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1  —  strong  negative 

mild  negative  twice  (2  and  2) 

2  — mild  negative 

3  —  no  mention 

4  —  unelaborated  mention 

5  — slightly  elaborated  mention;  e.g.,  ''very  .  . 

two  or  more  unelaborated  mentions  (4  and  4) 

6~-strongly  elaborated  mention;  e.g..,  ^'outstanding  in  .  . 

"extremely  good  at  .  . 

two  or  more  slightly  elaborated  mentions  (5  and  5) 
one  slightly  elaborated  and  two  or  more  unelaborated 
mentions  (5  and  4  and  4) 

7 —two  or  more  strongly  elaborated  mentions  (6  and  6) 

one  strongly  elaborated  mention  and  two  or  more  other  lower 

positive  mentions  (6  and  5  and  5)  (6  and  5  and  4)  (6  and  4  and  4) 

8  — very  strongly  elaborated  mention;  e.g,,  "one  of  the  best 

I've  seen  in  .  .  ." 

9  —  superlative  mention;  e.g.,  "undoubtedly  the  very  finest  in  .  . 

two  or  more  very  strongly  elaborated  mentions  (8  and  8) 

It  will  be  noted  that  frequency  can  boost  a  score  only  one  step  above  the  qualitative  score,  and 
that  frequency  cannot  help  to  achieve  a  score  of  8.  The  9-step  scale  was  used  for  all  content 
categories  shown  in  Appendix  II  except  where  different  scales  are  indicated. 

The  third  revision  contained  102  categories,  not  counting  the  distinction  between  concrete 
examples  and  general  statements.  This  was  reduced  to  70  by  combining  categories  which  had  low 
frequencies  as  indicated  by  analysis  of  the  content  data  for  several  hundred  officers,  both  Com¬ 
munications  and  R6cD.  It  was  also  found  that  the  distinction  between  ratee  acts  and  rater  judg¬ 
ments  resulted  in  a  duplication  of  the  ratee-act  categories  in  the  rater-judgment  categories.  Since 
almost  every  time  an  act  was  cited  there  was  also  an  indication  of  the  rater's  judgment  as  to  the 
value  or  the  effectiveness  of  the  act,  the  distinction  was  dropped  and  the  categories  were  com¬ 
bined  where  possible.  The  distinction  between  concrete  example  and  general  statement  was 
preserved  for  19  of  the  categories,  and  the  total  number  of  content  categories  was  frozen  at  89. 

A  low  level  of  abstraction  was  maintained  in  the  scoring  procedure  by  rationally  grouping  similar 
concrete  terms  together  in  single  categories  without  assigning  a  single  name  or  label  to  the  cate¬ 
gory.  Thus  the  analyst  was  able  to  compare  a  bit  with  relatively  concrete  items  in  the  category 
outline  rather  than  with  abstract  terms. 

The  several  hundred  records  that  had  been  scored  using  one  of  the  three  earlier  content 
analysis  systems  were  then  re-scored  using  the  fourth  and  final  set  of  categories.  Any  statements 
which  could  not  be  readily  categorized  using  the  final  set  of  categories  were  ignored  under  the 
assumption  that  their  total  frequencies  would  be  very  small. 

Five  different  content  analysts  were  used  during  the  course  of  the  study.  Most  of  the  records 
were  scored  by  research  assistants  who  had  approximately  one  year  of  graduate  study  in  psycho¬ 
logy.  The  first  step  in  training  consisted  of  categorizing  approximately  200  bits  of  information, 
on  separate  slips  of  paper.  The  sort  was  then  discussed  and  clarifications  were  made  as  needed. 
The  next  step  consisted  of  independently  scoring  10  new  records  which  were  also  scored  by  the 
staff  member  who  developed  the  categories.  The  two  scorings  were  then  compared  and  differences 
were  discussed.  It  was  found  that  the  principal  differences  lay  in  determining  what  constituted  a 
scorable  "bit,"  as  opposed  to  job  or  mission  description-  Agreement  as  to  category  averaged 
90  percent  for  agreed-upon  bits.  Agreement  as  to  qualitative  level  averaged  85  percent  for  agreed- 
upon  bits.  Agreement  as  to  "bits"  ranged  from  60  to  80  percent.  Since  category  agreement  was 
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high,  the  general  rule  adopted  was  to  treat  something  as  a  ''bit''  if  in  doubt.  The  analyst  then 
proceeded  to  score  more  records,  conferring  on  questionable  cases.  His  results  were  then  spot- 
checked  and  any  consistent  errors  were  corrected. 

Several  content  totals  were  generated  during  content  analysis  and  were  included  as  predictor 
variables.  These  are  shown  in  Table  4. 


TABLE  4.  Predictors  Derived  from  Content  Totals 


Variable 

Number  Name  of  Variable 

60  Length  of  Section  V  (number  of  lines  of  text) 

61  Number  of  scorable  units  of  information 

62  Number  of  examples  of  effective  performance 

63  Number  of  examples  of  ineffective  performance 

64  Number  of  information  units  involving  ineffectiveness 

65  Analyst's  rating  of  ratee  (based  on  Sec.  V) 


DATA  ANALYSIS  METHODS 

Since  the  chief  purpose  of  the  study  was  to  determine  the  feasibility  of  using  certain  infor¬ 
mation  to  identify  variables  relevant  to  success  as  an  officer,  which  is  essentially  a  prediction 
problem  the  chief  method  of  analysis  involved  multiple  correlation.  The  model  used  was  the 
"general  multiple  linear  regression  model,"  described  in  detail  by  Bottenberg  (1960).  In  this 
model,  criterion  scores  are  predicted  using  those  weights  for  predictor  variables  which  minimize  the 
sum  of  the  squared  differences  between  the  predicted  and  observed  criterion  scores.  The  computing 
procedure  is  an  iterative  one,  with  each  iteration  selecting  a  variable  and  a  correction  for  the 
weight  of  that  variable  which  maximally  increases  the  squared  multiple  correlation  coefficient  if 
weights  for  all  other  variables  are  unchanged  from  what  they  were  prior  to  the  given  iteration.  As 
iterations  continue,  increases  in  the  resulting  squared  multiple  correlation  coefficient  tend  to  get 
smaller.  An  "iteration-stop  criterion"  is  used  as  a  control  to  terminate  the  computations.  In  this 
study,  computation  was  terminated  when  the  increase  in  the  squared  multiple  from  one  iteration  to 
the  next  fell  below  .0005. 

The  computer  used  was  the  IBM  7090,  since  this  was  the  only  computer  available  with  a 
sufficiently  large  memory  to  handle  165  variables.  With  this  many  variables,  however,  the  number 
of  observations  in  each  variable  had  to  be  constant.  This  precluded  certain  types  of  analysis,  for 
example,  intercorrelations  of  content  variables  and  correlations  between  content  variables  and  the 
criteria  based  only  on  cases  of  mention  of  an  attribute. 

The  requirement  for  equal  Ns  in  each  variable  also  necessitated  special  treatment  of  missing 
observations.  Officers  for  whom  any  pages  of  the  Form  11  were  missing  were  dropped  from  the 
sample.^  Where  occasional  data  were  missing,  a  mean  score  for  the  variable  was  computed  for  a 
sample  of  200  officers  and  this  value  was  substituted  for  the  missing  data.  Where  appropriate, 
the  sample  used  to  determine  the  mean  was  made  up  of  comparable  officers.  For  example,  if  a 
man's  year  of  birth  was  missing,  the  mean  was  based  on  a  sample  of  officers  in  the  some  grade  as 
the  one  whose  year  of  birth  was  missing;  if  level  of  education  was  missing,  the  sample  consisted 
of  officers  with  similar  AFSCs. 


This  accounts  for  a  loss  of  14  Communication  Officers  appearing  in  Table  6  and  not  in 
later  analyses. 
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To  keep  within  the  memory  capacity  of  the  computer  and  still  retain  the  large  number  of  vari¬ 
ables  selected  for  study,  it  was  necessary  to  devise  a  method  for  scaling  not  only  the  content 
variables  but  several  qualitative  background  and  experience  variables  as  well.  The  scaling 
method  chosen  involved  the  use  of  mean  criterion  scores.  In  this  method,  each  preselected  score 
or  step  in  a  variable  is  assigned  the  mean  value  of  the  criterion  scores  for  all  cases  receiving  the 
given  score.  Thus  the  scale  values  and  the  distances  between  steps  are  determined  on  an  empir¬ 
ical  rather  than  on  an  arbitrary  basis.  Predictor  variables  for  which  mean  criterion  score  transfor¬ 
mations  were  made  are  shown  in  Table  5. 


TABLE  5.  Variables  with  Mean  Criterion  Score  Transformation 


Vortable 

Number 

Name  of  Variable 

Variable 

Number 

Name  of  Variable 

3 

Source  of  Commission 

35 

Coded  duly  AFSC 

4 

Relative  speed  of  promotion 

36 

Command  (OER) 

14 

Highest  enlisted  rank 

38 

Rater  grade 

19 

Highest  career  school 

39 

Relative  level  of  rater 

20 

Level  of  education 

41 

Subscale  1  —  Job  knowledge 

21 

Major  academic  field 

42 

Subscale  2  —  Cooperation 

22 

Rating/flying  status/jet  qualification 

43 

Subscale  3 — Judgment 

25 

Grade 

44 

Subscale  4— Management  qualities 

26 

Security  clearance  level 

45 

Subscale  5— Leadership 

27 

Marital  status 

46 

Subscale  6 —Communication  facility 

28 

Religion 

47 

Subscale  7— Promotion  potential 

29 

Race 

50 

Responsibility  score 

30 

Career  preference 

51 

Initiative  score 

31 

Command  preference 

52 

Adaptability  score 

32 

School  preference 

53 

Creativity  score 

33 

Next  assignment  preference 

54 

Reaction  to  stress  score 

34 

Awards  (dated  1952  and  later) 

66-154 

Content  analysis  categories 

CROSS  VALIDATION 

Two  cross-validation  analyses  were  done  to  compare  shrinkage  in  the  multiple  correlation 
using  mean  criterion  scores  for  qualitative  variables  with  shrinkage  resulting  with  the  use  of 
a  priori  values.  The  overall  rating,  Section  IV  of  the  OER,  was  the  criterion  in  both  analyses. 

The  49  predxctor  variables  selected  consisted  of  the  7  OER  subscales  and  42  content 
variables.  The  latter  were  chosen  so  as  to  be  representative  of  all  the  major  categories  contained 
in  the  category  system.  The  Communications  Officers  (N  =  1219)  were  split  into  an  odd  and  even 
group  based  on  roster  numbers  assigned  alphabetically.  Two  sets  of  six  prediction  problems  each 
were  computed  for  the  odd  sample,  with  one  set  based  on  a  priori  scores,  and  the  other  on  mean 
criterion  scores.  The  six  problems  were  as  follows: 

1  —  all  49  variables 

2  —  42  content  variables  only 

3  —  7  subscaie  variables  only 

4  —  10  content  variables  only,  randomly  selected  from  the  pool  of  42 

5  —  20  content  variables  only,  randomly  selected  from  the  pool  of  42 

6  —  30  content  variables  only,  randomly  selected  from  the  pool  of  42 

Weights  obtained  in  each  problem  were  applied  to  the  even  sample  and  correlations  were 

computed  between  predicted  and  actual  criterion  scores.  In  applying  the  weights  obtained  in 
problems  using  mean  criterion  scores,  the  mean  criterion  scores  computed  for  the  odd  sample 
were  also  applied  to  the  even  sample.  The  results  of  the  cross  validation  are  shown  in  Table  6. 
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TABLE  6.  Results  of  Cross-Validation  Analysis 


Problem 

Humber 

Prediction 

Variables 

Mean 

Criterion  Scores 

A  Priori  Scores 
r2’  ,2**  (R^.r^) 

1 

7  subscales 

.8857 

.8828 

.0029 

.8631 

.8801 

&  42  content 

2 

42  content 

,4877 

.4393 

.0484 

.3694 

.3727 

3 

7  subscales 

.8719 

.8799 

.8555 

.8829 

4 

10  content 

.2922 

.2473 

.0449 

.2011 

.1940  .0071 

5 

20  content 

.3818 

.3692 

.0126 

.2712 

.2734 

6 

30  content 

,4524 

,4526 

— 

.3368 

.3919 

Squared  multiple 

correlation  coefficient 

with  OER  Section  IV 

as  criterion; 

odd  sample;  N  =  612. 

♦  * 

Squared  Pearson  r  between  predicted  and  actual  criterion  score;  even  sample; 

N=607. 


While  the  shrinkage  is  somewhat  greater  using  the  mean  criterion  scores,  the  resulting 
shrunken  R^s  are  nevertheless  higher  in  all  instances  except  one.  This  finding,  coupled  with  the 
fact  that  the  mean-criterion-score  method  provides  an  objective  means  of  scaling,  was  sufficient 
advantage  to  use  it  in  place  of  a  priori  arbitrary  scores.  The  technique  has  general  application 
wherever  there  is  a  problem  of  assigning  values  to  categories  which  are  to  be  grouped  together  for 
use  as  a  single  predictor.  In  this  study  it  made  possible  the  combination  of  such  items  as  major 
academic  fields  into  one  predictor,  religion  into  another,  and  flying  status  into  still  another.  Its 
use  was  required  in  determination  of  the  most  appropriate  values  for  the  no-mention  category  of 
content  analysis  variables. 


5.  RESULTS 

The  chief  quantitative  results  of  this  study  are  contained  in  the  unpublished  intercorrelation 
matrices,  the  regression  analyses,  and  the  frequency  distributions.^ 

Three  intercorrelation  matrices,  with  165  variables  in  each,  were  computed,  as  follows: 


Matrix 

Sample 

N 

Criterion  used  for 

Mean  Criterion  Scores 

1 

1  —  Communications  Officers 

1205 

OER  Section  IV  (var.  40) 

2 

9  —  R  <S  D  Officers 

1812 

OER  Section  IV  (var.  40) 

3 

9  —  R  6c  D  Officers 

1812 

Active  duty  status  (var.  155) 

Available  on  loan  to  qualified  requesters  from  6570th  Personnel  Research  Laboratory, 
Lackland  AFB,  Texas. 
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Each  regression  problem  was  run  four  times:  once  for  each  of  the  two  samples  and  once  for 
each  of  the  two  criteria.  The  four  '^types''  of  each  regression  problem  and  the  input  matrix  for 
each  were  as  follows: 


Regression 

Type 

Sample 

Criterion 

Input 

Matrix 

IIXX 

1  —  Communications  Officers 

OER,  Section  IV 
(var.  40) 

1 

12XX 

1  —  Communications  Officers 

Active  duty  status 
(var.  155) 

1 

91XX 

9  — R<StD  Officers 

OER,  Section  IV 
(var.  40) 

2 

92XX 

9  —  R  &  D  Officers 

Active  duty  status 
(var.  155) 

3 

Twelve  different  types  of  regression  problems  were 

computed,  for  a  total  of  48  problems 

The  variables  included  in  each  problem  are  indicated  below: 

OEH  Section  IV  as  criterion  (var,  40} 

1101:  All  variables  minus  active  duty  status  (155);  1-39,  41-154,  156-165 

9101:  All  variables  minus  active  duty  status  (155);  1-39,  41-154,  156-165 

1102:  Subscales;  41-47 

9102:  Subscales:  41-47 

1103:  Form  11  variables;  1-34 

9103:  Form  11  variables;  1-34 

1104:  Content  analysis  variabies;  except  ^'global  evaluation"  (138)  and  "should  be  promoted" 
(141),  which  were  eliminated  on  the  basis  of  high  validities;  66-137,  139-140,  142-154 
9104:  Content  analysis  variables;  same  as  1104  except  "taking  courses  for  credit"  (148)  and 

"job-related  hobbies"  (152),  which  were  eliminated  because  of  extremely  small  variances 
which  produced  spuriously  high  intercorrelations;  66-137,  139-140,  142-147,  149-151, 
153-154 

1105:  Content  and  Form  11;  same  as  1103  and  1104;  1-34,  66-137,  139-140,  142-154 

9105:  Content  and  Form  11;  same  as  9103  and  9104;  1-34,  66-137,  139-140,  142-147,  149-151, 

153-154 

1106:  Content  and  subscales;  same  as  1102  and  1104;  41-47,  66-137,  139-140,  142-154 

9106:  Content  and  subscales;  same  as  9102  and  9104;  41-47,  66-137,  139-140,  142-147,  149-151, 

153-154 

1107:  Form  11  and  subscales;  same  as  1102  and  1103;  41-47,  1-34 

9107:  Form  11  and  suJbscaies;  same  as  9102  and-9103;  41-47,  1-34 

1108:  Non-content  OER;  35-39,  48-59 

9108:  iVon-content  OER;  35-39,  48-59 

1109:  Content  totals;  60-65 

9109:  Content  totals;  60-65 

1110;  Content,  grade,  and  command;  36,  66-137,  139-140,  142-154,  156-160 

9110:  Content,  grade,  and  command;  36,  66-137,  139-140,  142-147,  149-151,  153-154,  156-160 

1111:  Content  and  command;  same  as  lllO/ minus  156-160;  36,  66-137,  139-140,  142-154 
9111:  Content  and  command;  same  as  9110  minus  156-160;  36,  66-137,  139-140,  142-147,  149-151, 
153-154 

1112:  Content  and  grade;  same  as  1110  minus  36;  66-137,  139-140,  142-154,  156-160 
9112:  Content  and  grade;  same  as  9110  minus  36;  66-137,  139-140,  142-147,  149-151,  153-154, 
156-160 
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Active  duty  status  as  criterion  (var.  155) 

1201:  All  variables;  same  as  1101  plus  OER  Section  IV  (40)  and  minus  "Awards''  (34),  eliminated 
because  of  spuriously  high  validity  resulting  from  data-collection  artifact;  1-33,  35-154,  156- 
165 

9201:  All  variables;  same  as  1201;  1-33,  35-154,  156-165 
1202:  Subscoles;  same  as  1102;  41-47 
9202:  Subscales;  same  as  1202;  41-47 

1203:  For/n  JJ  variables;  same  as  1103;  minus  "Awards"  (34);  1-33 
9203:  Form  II  variabies;  same  as  1203;  1-33 

1204:  Content  analysis  variables;  same  as  1104;  66-137,  139-140,  142-154 

9204:  Content  analysis  variables;  same  as  1204;  66-137,  139*'140,  142-154 

1205:  Content  and  Form  11;  same  as  1105  minus  "Awards"  (34);  1-33,  66-137,  139-140,  142-154 

9205:  Content  and  Form  11;  same  as  1205;  1-33,  66-137,  139-140,  142-154 

1206:  Content  and  subscales;  same  as  1106;  41-47,  66-137,  139-140,  142-154 

9206:  Content  and  subscales;  same  as  1206;  41-47,  66-137,  139-140,  142-154 

1207:  Form  11  and  subscales;  same  as  1107  minus  "Awards"  (34);  1-33,  41-47 

9207:  Form  11  and  subscaies;  same  as  1207;  1-33,  41-47 

1208:  Non-content  OFF;  same  as  1108;  35-39,  48-59 

9208:  Non-content  OER;  same  as  1208;  35-39,  48-59 

1209:  Content  totals;  same  as  1109;  60-65 

9209:  Content  totals;  same  as  1209;  60-65 

1210:  Content,  grade,  and  command;  same  as  1110;  36,  66-137,  139-140,  142-154,  156-160 

9210:  Content,  grade,  and  command;  same  as  1210;  36,  66-137,  139-140,  142-154,  156-160 

1211:  Content  and  grade;  same  as  1111;  36,  66-137,  139-140,  142-154 

9211:  Content  and  grade;  same  as  1211;  36,  66-137,  139-140,  142-154 

1212:  Content  and  grade;  same  as  1112;  66-137,  139-140,  142-154,  156-160 

9212:  Content  and  grade;  same  as  1212;  66-137,  139-140,  142-154,  156-160 

The  squared  multiple  correlation  coefficients  obtained  in  these  problems  are  shown  in 
Table  7  together  with  the  number  of  variables  included  in  each  problem  and  the  number  of  variables 
whose  weights  were  corrected  from  zero.  Table  10  Appendix  ..V,  shows  the  OER  problems  entered 
by  each  variable  and  the  direction  of  corrected  weight,  if  any.  It  also  contains  the  correlation  of 
each  variable  with  the  OER  rating. 

Inspection  of  Table  7  indicates  that  the  order  of  magnitude  for  the  12  R^s  using  the  OER 
criterion  is  almost  exactly  the  same  for  the  two  samples,  with  a  rank-order  correlation  between 
them  of  .984.  In  both  samples,  the  second  highest  was  obtained  using  a  combination  of  the 
content  variables  and  the  subscales.  For  both  samples,  the  next  highest  F^  was  achieved  by  the 
subscales  alone,  with  the  addition  of  Form  11  variables  to  the  subscales  adding  nothing  to  the 
F^.  In  both  cases,  the  eight  variables  with  corrected  weights  for  the  problem  combining  Form  11 
variables  and  subscales  (07)  consist  of  the  seven  subscales  and  one  Form  11  variable.  Table  7 
also  indicates  that  the  Form  11  variables  alone  (problem  03)  are  relatively  poor  predictors, 
yielding  the  lowest  F^'  for  Communications  Officers  and  the  next-to-the-lowest  F^  for  R&D 
Officers. 

These  findings  are  not  matched  by  the  ffs  using  active  duty  status  as  the  criterion,  except 
that  here  too  the  order  of  magnitude  is  the  same  for  the  two  samples  (rho  -  .976).  Inspection  of 
these  F's  indicates  that  the  Form  11  variables  are  relatively  good  predictors  of  this  criterion. 

This  may  be  attributed  to  the  fact  that  Form  11  variables  such  as  grade  and  age  are  highly  cor¬ 
related  with  active  duty  status,  with  the  younger  officers  constituting  a  large  proportion  of  those 
who  were  released  from  active  duty.  Neither  the  subscales  nor  the  content  variables  predicted 
active  duty  status  as  well  as  they  predicted  the  OER  criterion,  but  the  content  variables  combined 
with  Form  11  somewhat  improved  the  F^'  for  Communications  Officers  compared  with  Form  11  alone. 
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TABLE  7.  Results  of  Regression  Analyses 
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Content  & 

grade  92  47  .525  90  53  .493  92  46  .306  92  22  .626 


Comparison  between  the  order  of  magnitude  of  the  fi^sfor  the  OER  criterion  and  those  for 
the  active  duty  status  criterion  shows  that  there  is  little  similarity  in  the  relative  effectiveness 
of  groups  of  variables  as  predictors.  For  Communications  Officers  rho  =  .201  while  for  R5rD 
Officers  rho-.173.  It  is  apparent  from  the  data  shown  in  Table  7  that  the  two  samples  of  officers 
are  highly  similar  to  each  other,  whether  one  is  predicting  the  OER  rating  or  active  duty  status, 
and  that  predicting  active  duty  status  is  a  considerably  different  problem  than  predicting  the 
OER  rating.  Further  analysis  of  the  weights  obtained  would  offer  considerably  more  detail  on 
both  of  these  findings. 

Table  7  also  indicates  that,  while  the  rank  order  of  the  fi'^s  is  the  same  for  the  two 
samples,  there  is  a  consistent  difference  between  them  with  regard  to  the  value  of  R^. 

For  the  OER  criterion,  all  fi^s  are  slightly  higher  for  the  Communications  Officers, 
with  the  exception  of  the  Form  11  problem  (03).  For  the  active  duty  status  criterion,  all  R^s  are 
considerably  higher  for  the  R  &  D  Officers.  This  is  due  jointly  to  the  difference  in  p/g  split 
between  R&D  Officers  and  Communications  Officers  on  active  duty  and  to  the  way  the  inter¬ 
correlation  matrices  were  formulated.  The  H^s  for  R  &  D  Officers  were  based  on  raw  data  trans¬ 
formed  to  mean  criterion  scores  based  on  active  duty  status,  while  the  corresponding  R^s  for 
Communications  Officers  were  based  on  raw  data  transformed  to  mean  criterion  scores  based  on 
OER  rating. 

The  F  test  for  the  significance  of  a  difference  between  multiple  R^s  (Guilford,  1956,  p.  400) 
was  applied  to  several  pairs  of  multiple  correlations  (using  the  OER  criterion)  in  which  one  is 
based  on  variables  forming  a  subset  of  the  variables  included  in  the  other.  The  obtained  values 
of  F  are  shown  in  Table  8. 

The  validities  for  all  variables  are  shown  in  Table  11,  Appendix  IV.  The  preponderance  of 
negative  correlations  with  active  duty  status  reflects  the  coding  scheme  for  the  criterion,  in  which 
''not  on  active  duty"  received  the  higher  score.  In  Table  9  the  variables  are  broken  out  according 
to  the  significance  of  their  validities  (with  the  OER  criterion)  in  the  two  samples.  Most  of  the 
variables  with  significant  validity  for  the  R  &  D  sample  only  are  Form  11  variables  which  generally 
reflect  the  fewer  years  of  military  service  of  this  group  as  compared  with  Communications  Officers."* 

Again,  the  general  impression  is  that  the  two  samples  are  more  alike  than  different.  With 
regard  to  the  content  analysis  variables,  it  was  found  that  76  out  of  the  89  variables  were  signifi¬ 
cant  (against  OER  rating)  for  the  R&D  Officers  and  76  were  significant  for  the  Communications 
Officers.  Five  content  variables  were  significant  for  R&D  only  and  five  were  significant  for 
Communications  Officers  only.  Eight  content  variables  were  not  significant  for  either  sample, 
and  71  were  significant  for  both. 

Similarity  between  the  two  groups  is  also  shown  by  several  other  findings.  For  example, 
correlations  were  computed  between  the  percentage  of  cases  with  "no-mention"  and  the  validity 
(with  OER)  for  all  89  content  categories.  For  Communications  Officers  the  obtained  r  was  -.614, 
and  for  R  &  D  Officers  r  --.360.  This  would  indicate  that  the  more  frequently  used  content  cate¬ 
gories  tended  to  have  the  higher  validities  in  both  samples.  In  addition,  the  mean  percentage  of 
no-mention  for  Communications  Officers  was  78.2  and  the  corresponding  mean  for  R&D  Officers 
was  78.5.  The  correlation  between  percentage  of  no-mention  for  the  two  groups  was  .829.  The 


Form  11  of  the  R&D  Officers  who  were  not  on  active  duty,  constituting  30%  of  the 
group,  were  quite  different  from  the  records  of  the  others.  Relatively  more  of  these  records  had 
no  entries  for  such  data  as  overseas  experience,  career  schools,  and  Item  19,  Assignments.  It 
is  not  known  whether  this  reflects  a  true  difference  between  those  released  from  and  those 
remaining  on  active  duty,  or  whether  the  Form  itself  undergoes  a  misleading  clerical  change 
when  an  officer's  records  are  transferred  to  the  Denver  Record  Center.  The  answer  to  this 
question  would  be  of  great  value  in  interpreting  all  the  findings  for  R&D  Officers,  and  partic¬ 
ularly  the  frequency  distributions  and  validities  for  active  duty  status. 
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TABLE  8.  Statistical  Evaluation  of  Diff  cences  Between  R^s 
(OER  criterion) 


Problem  Pairs 

Communications  Officers 

R  8c  D  Officers 

‘If. 

F 

R^ 

F 

01-all  variables 

.908 

.870 

vs. 

156 

1041 

.87 

156 

1648 

.81 

02-OER  subscales 

.896 

.860 

05-content  &  Form  11 

.563 

.511 

vs. 

34 

1083 

2.99* 

34 

1692 

* 

3.56 

04-content  only 

.522 

,476 

06-content  &  subscales 

.901 

,865 

vs. 

87 

1110 

.64 

87 

1717 

.73 

02-subscales  only 

.896 

.860 

10-content,  grade  & 

command 

.540 

.502 

vs. 

6 

nil 

7.25* 

6 

1720 

14.97* 

04-content  only 

.522 

.476 

11 -content  &  command 

.538 

.487 

VS- 

1 

1116 

38.65* 

1 

1725 

36.99* 

04-content  only 

.522 

.476 

12-content  &  grade 

.525 

.493 

VS. 

5 

1112 

1.41 

5 

1721 

11.54* 

04-content  only 

.522 

.476 

10-content,  grade 

&  command 

.540 

,502 

vs. 

5 

nil 

.97 

5 

1720 

10.36* 

11-content  &  command 

.538 

.487 

10-content,  grade 

6t  command 

.540 

.502 

vs. 

1 

nil 

36.23* 

1 

1720 

31.08* 

12-content  &  grade 

.525 

.493 

Significant  beyond  the  1%  level  of  confidence. 

correlation  between  content  validities  was  .776;  the  mean  content  validity  for  Communications 
Officers  was  ,174  and  for  R&O  it  was  .149.  Finally,  the  correlation  between  ail  OER  validities 
was  .890,  with  a  mean  validity  of  .183  for  Communications  Officers  and  a  mean  validity  of  .190 
for  R&D  Officers. 


DISCUSSION 

This  research  was  a  feasibility  study  to  identify  variables  relating  to  success  in  the  Com¬ 
munications  Officer  Specialty  and  in  the  Research  and  Development  Engineering  and  Scientific 
Career  Area.  The  study  involved  a  content  analysis  of  Section  V,  the  word  picture,  of  the 
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TABLE  9.  Significance  of  Validities  by  Sample 


Significant  Validity  for  Both  Samples 


1 

Months  in  active  comm  serv 

73 

Judgment 

3 

Source  of  commission 

74 

Keen 

8 

Months  in  field 

76 

Apply  knowledge 

12 

Average  responsibility  level 

77 

Decisive 

16 

Component  —  Regular  Officer 

78 

Meets  req  X 

17 

Component  —  Reserve  Officer 

79 

Meets  req 

20 

Level  of  education 

80 

Sound  X 

21 

Major  academic  field 

81 

Sound 

24 

Age  in  years 

83 

Creative 

25 

Grade 

84 

Drive  X 

27 

Marital  status 

85 

Drive 

30 

Career  preference 

87 

Determination 

32 

School  preference 

89 

Task  oriented 

34 

Awards 

91 

Accepts  resp 

35 

Coded  Duty  AFSC 

92 

Cooperative  X 

36 

Coded  Duty  AFSC 

93 

Cooperative 

38 

Rater  grade 

94 

Plans  X 

39 

Relative  level  of  rater 

95 

Plans 

40 

Overall  effectiveness,  OER  (criterion  score) 

96 

Written  comm  X 

41 

Subscale  1  —  Job  Knowledge 

97 

Written  comm 

42 

scale  2  —  Cooperation 

98 

Oral  Comm  X 

43 

Subscale  3  —  Judgment 

99 

Oral  Comm 

44 

Subscale  4  —  Mgmt  gual 

100 

Management  X 

45 

Subscale  5  —  Leadership 

101 

Management 

46 

Subscale  6  —  Communication  facility 

102 

Coordination  X 

47 

Subscale  7  —  Promotion  potential 

103 

Coordination 

48 

No.  of  addit  factors  rated 

104 

Analysis  X 

50 

Responsibility  score 

105 

Analysis 

51 

Initiative  score 

106 

Leadership  X 

52 

Adaptability  scor^ 

107 

Leadership 

53 

Creativity  score 

110 

Trustworthy 

56 

Initiative  not  rated 

111 

Dependable 

60 

Length  of  Section  V 

112 

Ambition 

61 

No.  of  scorable  units  of  information 

113 

Loyal 

62 

No.  of  ex  of  effective  performance 

114 

Conscientious 

63 

No.  of  ex  of  ineffective  performance 

115 

Career  minded 

64 

No.  of  inf  units  involving  ineffectiveness 

117 

Positive  effect 

65 

Analyst's  rating  of  ratee 

118 

Mature 

66 

Analytical 

119 

Conforms  to  AF 

67 

Direct  X* 

122 

Considerate 

68 

Direct 

123 

Understanding 

69 

Methodical  X 

124 

Strong 

70 

Methodical 

125 

Effective  prog 

71 

Initiative  X 

126 

Impr  tech  ops 

72 

Initiative 

127 

Monetary  savings 

X  indicates  score  for  concrete  example  of  the  attribute. 
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Table  9  (Continued) 


Significant  validity  for  both  samples  (Continued) 


128  Personnel  util 

140 

Incr  resp 

129  Attitude  of  unit 

141 

Promoted 

130  Unit  commend 

142 

Remain 

131  Unspec  results 

143 

Staff 

132  Tech  knowl 

144 

Command/teaching 

133  Experience 

146 

Prof  school 

134  Well-qual 

151 

Studies 

135  Related  areas 

153 

Civic  resp 

136  Interest  in  field 

155 

Active  duty  status 

137  Supervision  required 

157 

1st  Lieutenant 

138  Global  evaluation 

163 

ROTC  graduate 

Significant  Validity  for  Communications  Officer  Only 

29  Race 

82 

Creative  X 

54  Reaction  to  stress  score 

108 

Personal  interest 

57  Adaptability  not  rated 

121 

Friendly 

75  Applying  knowledge  X 

147 

Tech  school 

Significant  Validity  for  R  &  D  Officer  Only 

2  Break  in  act  comm  serv 

26 

Security  clearance  level 

4  Relative  speed  of  promotion 

28 

Religion 

5  Months  in  grade 

31 

Command  pref 

6  Mos  overseas  as  an  officer 

33 

Next  assign  preference 

7  Overseas  serv  as  an  officer 

37 

Civilian  rater 

10  No,  of  AFSCs  held 

49 

Unique  factor  rated 

11  No.  of  assignments  in  field 

58 

Creativity  not  rated 

13  Combat  exper 

86 

Determination  X 

14  Highest  enl  rank 

88 

Task  oriented  X 

15  No  enlisted  service 

120 

Sense  of  humor 

18  No,  of  serv  school  courses 

145 

Other 

19  Highest  career  school 

154 

Int  flying 

22  Rating/flying  status/jet  qualif 

158 

Captain 

23  Total  flying  hours 

159 

Major 

Validity  not  Significant  for  Either  Sample 

9  Duty  not  in  primary  field 

150 

Plans  for  education 

55  Responsibility  not  rated 

152 

Hobbies 

59  Reaction  to  stress  not  rated 

156 

2nd  Lt 

90  Accepts  responsibility 

160 

Lt  Col 

109  Instructions 

161 

Maj  acad  field  in  engr^ 

116  Quiet 

science,  &  math 

139  Temp  duty 

162 

More  than  2  yrs  of  college 

148  Courses  for  credit 

164 

Maj  acad  field  in  bus  admin 

149  Mil  courses 

165 

(St  management 

Maj  acad  field  in  lib  arts 

16 


effectiveness  report  as  a  major  portion  of  the  effort.  Bearing  in  mind  the  feasibility  aspect  of  the 
research,  it  is  seen  that  the  effort  met  its  goals.  Consistent  categories  of  description  were  found 
which  have  an  appreciable  relation  to  the  criterion  of  overall  effectiveness  rating.  In  arriving  at 
these  results  new  ground  was  broken  and  a  great  deal  of  data  were  compiled  for  future  analyses. 

A  major  innovation  was  the  test  and  exploitation  of  a  technique  for  combining  an  array  of  categories 
into  a  single  predictor  variable  so  as  to  maximize  its  validity  with  the  criterion.  This  technique 
replaced  an  arbitrary  predictor  weight  for  each  category  by  the  mean  criterion  value  observed  for 
the  cases  in  that  category.  Another  pioneering  effort  was  the  application  of  the  multiple  linear 
regression  model  to  problems  containing  165  predictors.  The  resulting  printouts  of  intercorrelation 
matrices  and  the  data  tapes  provide  a  reservoir  for  future  analyses.  Other  lesser  results  of  the 
study  are  refinements  of  coding  objective  data  from  the  officer  record,  among  which  are  better 
coding  of  educational  history  and  a  weighting  scheme  for  recording  responsibility  levels  of  previ¬ 
ous  duty  assignments.  It  is  hoped  that  the  extensive  data  from  this  study  will  provide  leads  for 
determination  of  the  most  important  factors  in  officer  effectiveness  which  differentiate  among 
officers  within  and  between  specialties. 
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APPENDIX  I:  DATA  CODES  AND  CARD  LOCATIONS 


Data  Codes:  Card  1 

Variable  Card 

Number  _ Name  of  Variable _  Column 

1  Months  in  active  commissioned  service  1-3 

Continuous  variable;  OER  date  nrinus  TAFCSD 

2  Break  in  active  commissioned  service  4 

Dichotomy 


I  -  more  than  3  months  difference  between  EAD  and  TAFCSD 
0  -  no  difference,  or  less  than  3  months  between  EAD  and 

TAFCSD 

3  Source  of  Commission  5-6  (MCS-11)* 

II  -  USMA  graduate  (A) 

12  -  USNA  graduate  (B) 

13  -  Distinguished  grad  of  ROTC  (RDMG)  (C) 

I  4  -  Distinguished  grad  of  OCS  (SDMG)  (D) 

15  '  Distinguished  grad  of  Flying  Trng.  Sch.  (FDMG)  (E) 

16  '  Miscellaneous  (H)((K)  (N)  (0) 

17  '  ROTC  graduate  (J) 

19  -  OCS  graduate  (SSCH)  (L) 

21  -  Flying  Training  Graduate  (AC)  (AVN)  (M) 

24  -  Direct  appointment  from  civil  life  (DPCiv)  (P) 

25  -  Unknown  (Z) 

4  Relative  speed  of  promotion  7  (MCS-3) 

1  -  Slov/er  than  average 

2  -  Average 

3  -  Faster  than  average 


Communications  Off. 

_ _ _ _ j 

R  &  D  Off. 

1st  Lt 

Copt 

Major 

1st  Lt 

Capt 

Major 

3  years 

or  more 

7  years 

or  more 

14  years 

or  more 

3  years 

or  more 

7  years 

or  more 

15  years 

or  more 

less 

than  2 

years 

5-6 

years 

9-13 

years 

less 

than  2 

years 

5-6 

years 

11-14 

years 

-- 

less 

than  4 

years 

less 
than  8 

years 

-- 

less 

than  4 

years 

less 

than  10 

years 

5  Months  in  grade  8-10 

Continuous;  OER  date  minus  date  of  highest  temporary  grade 


MCS  signifies  that  the  levels  were  converted  to  Mean  Criterion  Scores,  The  number  indicates 
the  number  of  levels  involved. 
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Card  1  (Continued) 

Variable 

Number  Name  of  Variable 


6  Months  overseas  as  an  officer 

Continuous  variable 
0  -  No  0/S  service  as  officer 

1  -  1“5  months 

2  -  6-18  months 

3  -  19-30  months 

4  -  31-42  months 

5  -  43-54  months 

6  -  55-66  months 

7  -  67-78  months 

8  -  79-90  months 
9-91  and  higher: 

7  Overseas  service  as  officer 

Dichotomy 

1  -  Any  0/S  service  as  officer 
0  -  None 

8  Months  in  field 

Continuous  variable;  OER  date  minus  date  entered  field  (earliest 
date  of  AFSC  with  same  first  2  digits  as  DAFSC). 

9  Duty  not  in  primary  field 

Dichotomy 

1  -  DAFSC  is  not  the  same  as  PAFSC  (3  digits) 

0  -  DAFSC  is  the  same  as  PAFSC  (3  digits) 

(if  no  PAFSC,  treat  as  0) 

10  Number  of  AFSC's  held 
Continuous  variable,  limit  of  9 

11  Number  of  assignments  in  field 

Continuous  variable;  C-E:  30xx 

R  <&  D:  84xx,  85xx,  86xx,  87xx,  88xx 

12  Average  responsibility  level 

Continuous  variable;  assignments  in  field  only.  (See  Appendix  III) 

13  Combat  experience 

Dichotomy 

1  -  In  combat  at  some  time 
0  -  Never  in  combat 

14  Highest  enlisted  rank 

0  -  No  enlisted  service  (or  A/C  only) 

2  -  Private 

3  -  Corporal;  T/5;  S  1/C 

4  -  Sergeant;  P.O.  3;  T/4 

5  -  Staff  Sergeant;  P.O.  2;  T/3 

6  -  Technical  Sergeant;  P.O.  1 

7  -  Master  Sergeant;  C.P.O. 

15  No  enlisted  service 

Dichotomy 

1  -  No  enlisted  service 
0  -  Any  enlisted  service  other  than  A/C 


Card 

Column 

11 


12 

13-14 

15 

16 

17-18 

19-20 

21 

22  (MCS-7) 
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Card  1  (Continued) 


Variable 

Number 

Name  of  Variable 

16 

Component-Regular  Officer 

Dichotomy 

1  -  Regular  officer 

0  -  Reserve  officer 

17 

Component  -  Reserve  Officer 

Dichotomy 

1  -  Reserve  officer 

0  -  Regular  officer 

'i 

18 

Number  of  service  school  courses 

Continuous  variable;  limit  of  9,  includes  correspondence  courses 

) 

19 

Highest  career  school 

0  -  None 

1  -  Squadron  Officer's  course 

2  -  Command  and  Staff  College 

20  Level  of  education 


0  -  Unknown 

1  -  High  school,  non-grad. 

2  -  High  school  grad. 

3  -  College,  1  yr.  (less  than  2);  30-59  sem.  hrs.;  45-89  quarter  hrs. 

4  -  College,  3  yrs.  (less  than  4);  60  or  more  sem,  hrs.;  90  or  more 

quarter  hrs. 

5  -  College  graduate 

6  -  Post-grad,  study,  no  degree 

7  -  Master^s  degree  or  2  bachelors'  degrees 

8-2  masters'  degrees  or  masters  in  field  other  than  bachelor's  degree 

9  -  Ph.  D,  M.D.  or  both 

21  Major  academic  field 

01  -  Engineering,  weapons  system;  general 

02  -  Engineering,  aeronautical 

03  -  Engineering,  electrical;  electronics 

04  -  Engineering,  mechanical 

05  -  Engineering,  nuclear 

06  -  Engineering,  chemical;  petroleum 

07  -  Engineering,  civil;  hydraulic 

08  -  Engineering,  safety 

09  -  Engineering,  industrial  &  production;  textile 

10  -  Physics,  general;  nuclear;  geo-;  biological 

11  -  Chemistry,  general;  nuclear,  biological 

12  -  Biology;  bio-radiolpgy;  bacteriology 

13  -  Meteorology 

14  -  Geology 

15  -  Metallurgy 

16  -  Ceramics;  ceramic  engineering 

17  -  General  science 

18  -  Nuclear  science 

19  -  Electricity;  electronics 

20  -  Mathematics,  general 


Card 

Column 

24 

25 

26 

27  (MCS-3) 

28  (MCS-10) 


29-30  (MCS-56) 
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Card  1  (Co/iiinuec/) 

Variable 

Number  Name  of  Variable 

21  (Cont'cf)  Major  academic  field  (Confinued) 

21  -  Math,  digital  computation 

22  -  Math,  linear  programming 

23  -  Math,  statistical 

25  “  Chemistry,  solid  state 

26  -  Engineering,  architectural  (naval) 

27  -  Engineering,  astronautical 

28  -  Physiology 

29  -  Botany;  plant  pathology;  horticulture 

30  -  Business  admin.,  general 

31  -  Management  (includes  industrial  relations,  marketing,  sales 

mgmt.,  public  relations,  advertising) 

32  -  Accounting 

33  “  Personnel  management 

34  -  Transportation 

35  “  Engineering  mgmt.  (includes  industrial  admin.) 

36  -  Research  &  development  mgmt. 

37  -  Public  Admin. 

40  -  Economics 

41  “  International  relations 

42  -  Political  science  (includes  geo-politics) 

43  -  Law 

44  “  Psychology 

45  “  Sociology  or  social  science 

46  “  Education 

47  -  Criminology  (includes  police  admin.) 

48  -  Liberal  arts;  humanities 

49  -  History 

50  -  Geography 

51  -  Photography;  photogrammetry;  cartography 

52  “  Foreign  languages 

53  “  Journalism 

54  -  English 

55  -  Theology 

60  -  Military  science 

61  -  Military  engineering 

62  -  All  other 

63  -  Unknown  or  none 

22  Rating/flying  status/jet  qualification 

1  Suspended 

2  -  non-pilot/not  on  flying  status/not  jet  qual.  (includes  unrated 

officers) 

3  -  non-pilot/on  fly  status 

4  -  pilot/not  on  fly  status/not  jet  qual. 

5  -  pilot/not  on  fly  status/jet  qual. 

6  -  Pilot/on  fly  status/not  jet  qual. 

7  -  Pilot/on  fly  status/jet  qual. 


Card 

Column 

29-30  (MCS-56) 


31  (MCS-7) 
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Variable 

Number 


Card  1  (Continued) 


Card 

Column 


Name  of  Variable 

23  Total  flying  hours 

Continuous  variable 
0  -  None 

1  -  1-500  hours 

2  -  501-1000 

3  -  1001-1500 

4  -  1501-2000 

5  -  2001-2500 

6  -  2501-3000 

7  -  3001-3500 

8  -  3501-4000 

9  -  Over  4000 

24  Age  in  years 

Continuous  variable;  date  of  OER  minus  date  of  birth  (years  only) 

25  Grade 

1  -  2nd  Lt 

2-  1st  Lt 

3-  Captain 

4  -  Major 

5  -  Lt  Col 

26  Security  clearance  level 

0  -  None 

1  -  Through  secret 

2  -  Top  secret 

3  -  Crypto 

4- Q 

27  Marital  status 

1  -  Single 

2  -  Married,  one  dependent 

3  -  Married,  two  or  more  dependents 

4  -  Widowed 

5  -  Divorced 

28  Religion 

1  -  Baptist,  Congregational,  Episcopalian,  Lutheran,  Methodist, 

Presbyterian,  Reformed 

2  -  Other  Protestant 

3  -  Catholic,  all 

4  -  Jewish,  all 

5  -  Other  than  Protestant,  Catholic,  or  Jewish 

6  -  Protestant,  unspecified 

7  -  No  preference 

8  -  Unknown 

29  Race 

1  -  Negro 

2  -  White;  Caucasian 

3  -  Mongolian 

4  -  American  Indian 

5  -  Malayan 


33-34 

35  (MCS-4) 

36  (MCS-5) 

37  (MCS-5) 

38  (MCS-8) 


39  (MCS-5) 
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Card  1  (Continued) 

Variable 

Number  Name  of  Variable 


30  Career  preference 

1  -  Same  as  duty  field  (OER) 

2  “  Different  from  duty  field  (OER) 

3  -  No  preference 

31  Command  preference 

1  -  Same  command  as  OER 

2  -  Different  command  from  OER 

3  -  No  preference 

32  School  preference 

1  -  Schooling  in  same  field  as  OiElR 

2  Schooling  in  field  different  from  OER 

3  “  No  preference 

4  -  Career  school  only  (Sq.  0.,  ACeSSS) 

33  Next  assignment  preference 

1  ••  Assignment  in  same  field  as  OER 

2  -  Assignment  in  field  different  from  OER 

3  -  No  preference 

34  Awards  (dated  1952  and  later) 

0  --  No  letter  of  appreciation  and  no  medal  (Unit  citation  is  not  a 
medal) 

1  -  Letter  but  no  medal 

2  -  Medal  but  no  letter 

3  “  Letter  and  modal 

4  -  No  information 

35  Coded  Duty  AFSC 


Comm,  officers  R  &  D  officers  (sec  below) 


1  -  3034 

2  -  3011 

3  -  3016 

4  “  30xx 

5  -  All  others 


1  -  Management 

2  -  Scientific 

3  -  Engineering 

4  “  Psychology 

5  -  Flight  Test 

6  -  Education  &  training 

7  -  All  others 


R  6r  D  Officers 

1  -  8416  R&D  Director 

8446  R  &  D  Admin. 

8464  R(ScD  Staff  Asst. 
86%  R&D  Off.  Special 

2  -  851,6  Nuclear  Res  Off 

8526  Math(‘maiician 
B55B  Phy.sicist 
8666  Chemist 
8576  M'dollurqist 
8586  Res  Biologist 


3  -  8616  Aero  Eng 

0626  Llectr  F.nq 
8636  Mecli  Elng 

8646  Computer  Prog  &Sys  Des  Eng 

4  8596  Re.s  Psychologist 

5  -  8744  lixp^'r  Pit  Test  Off 

6  -  75x1'  cS  Trng  Off 

7  •  All  otlu.‘rs 


Card 

Column 

40  (MCS-3) 


41  (MCS-3) 


42  (MCS~4) 


43  {MCS-3) 


44  (MCS-S) 


45  (MCS-5) 
(MCS-7) 
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Variable 

Number 


Card  1  ( Coni/nued) 


Card 

Column 


Name  of  Variable 


36 


37 


38 


39 


40 


Command  (OER) 

11  *  Air  Force  Academy 

12  -  Air  Defense  Com 

13  -  Air  Materiel  Com 

14  -  Air  Res  cS  Dev  Com 

15  -  Air  Trng  Com 

16  -  Air  Univ 

17  -  Alaskan  Air  Com 

18  -  Caribbean  Air  Com 

19  -  Continental  Air  Com 
21  -  Pacific  Air  Force 


46-47  (MCS-20) 

22  -  USAF  Hq 

23  -  Hq  Corn,  USAF 

24  -  Mil  Air  Transp  Serv 

25  “  Strategic  Air  Com 

26  -  Tactical  Air  Com 

27  -  US  Air  Forces  in  Europe 

28  -  USAF  Security  Service 

29  -  AF  Accounting  Finance  Div 

30  -  Other  (SHAFE,  MAP,  etc,) 

31  -  Unknown 


Civilian  rater 
Dichotomy 

1  -  rater  is  a  civilian 
0  -  rater  is  not  a  civilian 
Rater  grade 
0  -  1st  Lt 

1  -  Captain 

2  -  Major 

3  -  Lt  Col 

4  -  Col 

5  -  General  Officer 

6  -  Civilian  up  to  GS-13 

7  -  GS-13 

8  -  GS-14 

9  -  GS-15  and  higher 
Relative  level  of  rater 

0  -  Same  level  as  ratee 

1  -  One  grade  higher 

2  -  Two  grades  higher 

3  -  Three  or  more  grades  higher 
Equivalents  of  civilian  grades 

GS-9  "  1st  Lt 
GS-11  -Captain 
GS-12  Major 
GS-13  *  Lt  Col 
GS-14  -  Lt  Col 
GS-15  -  Col 

GS-16  &  up  -  General  Officer 
Overall  effectiveness,  OER  (criterion  score)  51 

0  -  Unsatisfactory 

1  -  Marginal 

2  -  Acceptable 

3  -  Dependable  j 

4  “  Dependable2 


— 

— 

_ 

0 

Jj 

2 

2 

3 

5 

6 

7 

8 

9 

9 

9 

48 


49  (MCS-10) 


50  (MCS-4) 
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Variable 

Number 

40  (ContM) 


41 

42 

43 

44 

45 

46 

47 

48 

49 

50 


51 

52 

53 

54 


Card  1  (Continued) 


Name  of  Variable 


Card 

Column 


Overall  effectiveness,  OER  (criterion  score)  (Continued) 

5  -  Dependable3 

6  -  Very  finej 

7  -  Very  fine2 

8  -  Very  fine3 

9  -  Outstanding 
Subscale  1  -  Job  knowledge 


51 


52  -53  (MCS-11) 


0  0  0 

1 

1 

1 

2 

2 

3 

4 

5 

6 

7 

8 

9 

Subscale  2  —  Cooperation 
See  variable  41 
Subscale  3  -  Judgment 
See  variable  41 

Subscale  4  -  Management  qualities 
See  variable  41 
Subscale  5  -  Leadership 
See  variable  41 

Subscale  6  -  Communication  facility 
See  variable  41 

Subscale  7  -  Promotion  Potential 
See  variable  41 

Number  of  additional  factors  rated 
Continuous  variable;  limit  of  3 
Unique  factor  rated  (factor  other  than  those  contained  in 
variables  50-54) 

Dichotomy 

1  -  At  least  one  unique  factor  is  rated 
0  -  No  unique  factor  is  rated 
Responsibility  score 
0  -  Not  rated 

1  -  Inadequate 

2  -  Satisfactory 

3  -  Competent  &  efficient 

4  -  Excellent 

5  -  Outstanding 
Initiative  Score 

See  variable  50 
Adaptability  score 
See  variable  50 
Creativity  score 
See  variable  50 
Reaction  to  stress  score 
See  variable  50 


54-55  (MCS-11) 
56-57  (MCS-11) 
58-59  (MCS-11) 
60-61  (MCS-11) 
62-63  (MCS-11) 
64-65  (MCS-11) 
66 
67 


68  (MCS-6) 


69  (MCS-6) 

70  (MCS-6) 

71  (MCS-6) 

72  (MCS-6) 
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Card  1  (Continued) 


Variable  Card 

Number  Name  of  Variable  Column 


Overall  effectiveness,  OER  73 

See  variable  40 

Active  duty  status  74 

0  -  On  active  duty  (in) 

1  “  Not  on  active  duty  (out) 

Sample  number  75 

1  -  Communications  Officers 

9  -  R  &  D  Officers 

Deck  No.  1  76 

Roster  Number  77-80 

Numerical  Code 

Data  Codes:  Cord  2 

55  Responsibility  not  rated  1 

Dichotomy 
1  -  not  rated 
0  -  rated 

56  Initiative  not  rated  2 

Dichotomy 
1  -  not  rated 
0  -  rated 

57  Adaptability  not  rated  3 

Dichotomy 
1  -  not  rated 
0  -  rated 

58  Creativity  not  rated  4 

Dichotomy 
1  -  not  rated 
0  -  rated 

59  Reaction  to  stress  not  rated  5 

Dichotomy 
1  -  not  rated 
0  '  rated 

60  Length  of  Section  V  6-8 

Continuous  variable;  numerical  code;  lines  of  text 

61  Number  of  scorable  units  of  information  9-10 

Continuous  variable;  numerical  code 

62  Number  of  examples  of  effective  performance  11-12 

Continuous  variable;  numerical  code 

63  Number  of  examples  of  ineffective  performance  13 

Continuous  variable;  numerical  code,  limit  of  9 

64  Number  of  information  units  involving  ineffectiveness  14 

Continuous  variable;  numerical  code;  limit  of  9 
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Variable 

Number 

65 


66-121 


Card  2  (Continued) 


Name  of  Variable 


Card 

Column 


Analyst's  rating  of  ratee  (based  on  Sec,  V)  15 

0  -  Unsatisfactory 

1  -  Marginal 

2  -  Acceptable 

3  -  Dependable  j 

4  -  Dependable 2 

5  -  Dependable 3 

6  -  Very  fine^ 

7  -  Very  fine2 

8  -  Very  fine  3 

9  -  Outstanding 

Content  analysis  categories  (56)  16-71  (MCS-504) 

See  Appendix  II 

Analyst  72 

1  -  KR 

2  -  JM 

3  -  AJF 

4  -  DSE 

5  -  SL 

Overall  effectiveness,  OER  73 

See  variable  40 

Active  duty  status  74 

Dichotomy 

1  -  Not  on  active  duly  (out) 


0  -  On  active  duty  (in) 

Sample  Number 

75 

1  -  Communications  Officer 

9  -  R  (Sr  D  Officer 

Deck  No,  2 

76 

Roster  Number 

77-80 

1 

2 

2 

2 

3 

± 

5 

6 

7 

8 

9 

9 

0 
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Data  Codes:  Card  3 

Variable 

Number  Name  of  Variable 


122-154  Content  analysis  categories  (33) 

See  Appendix  II 

155  Active  duty  status  (criterion) 

Dichotomy 

1  -  Not  on  active  duty  (out) 

0  -  On  active  duty  (in) 

156  2nd  Lieutenant 

Dichotomy 
1  -  2nd  Lieutenant 
0  -  Not  a  2nd  Lieutenant 

157  1st  Lieutenant 

Dichotomy 
1  -  1st  Lieutenant 
0  -  Not  a  1st  Lieutenant 

158  Captain 

Dichotomy 
1  -  Captain 
0  *  Not  a  captain 
1^9  Major 

Dichotomy 
1  -  Major 

.  0  -  Not  a  Major 

160  Lt.  Colonel 

Dichotomy 
1  -  Lt  Colonel 
0  -  Not  a  Lt  Colonel 

161  Major  academic  field  in  engineering,  science,  or  math 

Dichotomy 

1  -  Yes  (Var.  21,  codes  01-29,  60  and  61) 

0  -  No 

162  More  than  2  years  of  college 

1  -  Yes  (Var.  20,  codes  4-9) 

0  -  No 

163  ROTC  graduate 

1  -  Yes  (Var.  3,  codes  13  and  17) 

0  -  No 

164  Major  academic  field  in  business  administration  or  management 

Dichotomy 

1  -  Yes  (Var.  21,  codes  30-37) 

0  -  No 

165  Major  academic  field  in  liberal  arts 

Dicho  tomy 

1  -  Yes  (Var.  21,  codes  40-55) 

0  -  No 

Primary  AFSC 
Numerical  code 


Card 

Column 

1-33  (MCS-216) 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

47-50 
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Variable 

Number 


Card  3  (Continued) 


Name  of  Variable 


Card 

Column 


Date  of  EAD 
Month  and  year 
TAFCSD 
Month  and  year 
Analyst's  rating  of  rater 

1  -  Poor 

2  “  Satisfactory 

3  “  Competent  and  efficient 

4  -  Outstanding 
Name 

Alpha  code;  first  3  letters  of  last  name  and  2  initials 
Serial  number 

Numerical  code;  regular  officers  have  X  in  65  &  66 
Analyst 

1  -  DSE 

2  -  SL 

3  -  JM 

4  -  KR 

5  -  AJF 

Overall  effectiveness,  OER 
See  variable  40 
Active  duty  status 
Dichotomy 

1  “  Not  on  active  duty  (out) 

0  “  On  active  duty  (in) 

Sample  number 
1  -  Communications  officer 
9  -  R  &  D  Officer 
Deck  No.  3 
Roster  number 


51-54 

55-58 

59 


60-64 

65-71 

72 


73 

74 


75 

76 

77-80 
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Data  Codes:  Card  4 


Variable  Card 

Number  Name  of  Variable  Column 


Date  of  highest  temporary  grade  1~4 

Month  and  year 

Ending  date  of  OER  5-8 

Month  and  year 

Year  of  birth  9-10 

Last  2  digits  of  year 

Aeronautical  rating  13 


1  -  Pilot,  Senior  Pilot,  Command  Pilot 

2  -  Non-pilot 

3  -  Non-rated 

4  -  Suspended 

Flying  status  14 

Dichotomy 
1  -  On  flying  status 
0  -  Not  on  flying  status 


Endorser's  score  for  subscale  1  15 

See  variable  41 

Endorser's  score  for  subscale  2  16 

See  variable  41 

Endorser's  score  for  subscale  3  17 

See  variable  41 

Endorser's  score  for  subscale  4  18 

See  variable  41 

Endorser's  score  for  subscale  5  19 

See  variable  41 

Endorser's  score  for  subscale  6  20 

See  variable  41 

Endorser's  score  for  subscale  7  21 

See  variable  41 

Endorser's  score  for  overall  effectiveness  22 

See  variable  40 

Duly  AFSC  23-26 

Numerical  code 

Overall  effectiveness,  OER  73 

See  variable  40 

Active  duty  status  74 

1  -  Not  on  active  duty  (out) 

0  -  On  active  duty  (in) 

Sample  number  75 

1  -  Communications  Officer 
9  -  R  &  D  Officer 

Deck  Number  4  76 

Roster  number  77-80 
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APPENDIX  II:  SEPARATE  LISTING  OF  CONTENT  ANALYSIS  CATEGORIES 


Variable 


Number 

Category 

1. 

Approach  to  job  problems 

66 

a. 

analytical;  logical  or  orderly  thinking 

67,  68* 

b. 

direct;  objective;  clear-thinking;  absence  of  irrelevancies; 
quick  to  grasp  situation;  correctly  evaluates  facts;  sees 
the  big  picture 

69,  70 

c. 

methodical;  thorough;  accurate;  attention  to  detail;  keeps 
accurate  records;  follows  through;  collects  all  facts 

71,  72 

d. 

initiative;  seeks  out  problems;  discovers  or  recognizes 
problems  or  inadequacies 

73 

e. 

good  judgment;  common  sense 

74 

f. 

keen;  alert;  intelligent;  quick  to  learn 

75,  76 

g* 

applying  knowledge;  understanding  of  technical  material; 
other  mental  abilities 

77 

h. 

decisive;  takes  quick  or  aggressive  action;  doesn't  delay 
decisions;  effective  in  emergencies 

78,  79 

2. 

i. 

meets  requirements;  completes  assignments;  prompt 

Solutions,  Decisions,  Recommendations,  or  Plans 

80,  81 

a. 

sound;  accurate;  correct;  logical;  appropriate;  practical; 
constructive 

82,  83 

3. 

b. 

creative;  original;  resourceful;  ingenious;  imaginative 

Efforts  at  getting  the  job  done 

84,  85* 

a. 

drive;  energetic;  hard-working;  industrious;  rapid;  intense; 
enthusiastic 

86,  87 

b. 

determination;  perservering;  tenacious;  eager  to  get  the  job 
done;  concentration 

88,  89 

c. 

task  or  goal  oriented;  professional  manner  or  attitude;  sub¬ 
ordinates  personal  convenience  or  desires;  gives  extra  effort 

90,  91 

d. 

accepts  responsibility;  welcomes  increased  responsibility 

92,  93 

4. 

e. 

cooperative;  provides  assistance;  works  as  member  of  team; 
harmonious  working  relations;  keeps  others  informed 

Specific  job  capabilities 

94,  95 

a. 

develops  effective  plans,  policies,  or  estimates 

96,  97 

b. 

effective  written  communications  (including  correspondence, 
studies,  and  reports):  factual;  concise;  clear;  well-written 

98,  99 

c. 

effective  oral  communications  (including  conferences  and 
briefings):  convincing;  clear;  factual 

100,  101 

d. 

effective  management  or  administration 

102,  103 

e. 

effective  in  dealing  with  other  agencies  or  organizations: 
coordination;  liaison;  good  working  relations;  negotiating 

ability 


Where  two  numbers  are  indicated,  the  first  number  refers  to  concrete  examples  of  the 
attribute,  as  distinct  from  more  general  statements. 


Card 

Column 

(Card  2) 
16 

17,  18 

19,  20 

21.  22 

23 

24 

25,  26 
27 

28,  29 

30,  31 
32,  33 

34,  35 

36,  37 

38,  39 

40,  41 
42,  43 

44,  45 
46,  47 

48,  49 

50,  51 
52,  53 
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Content  Analysis  Categories  (Continued) 


Variable  Card 


Humber 

Category 

Column 

104,  105* 

4. 

Specific  job  capabilities  (Continued) 
f.  effective  analysis,  review,  or  special  studies 

(Card  2) 

54,  55 

106,  107 

5. 

Directing  others 

a.  effective  leadership,  supervision,  or  management  of  sub¬ 

56.  57 

108 

ordinates;  utilizes  personnel  properly;  delegates  authority 
b.  shows  personal  interest  in  others;  loyal  to  subordinates; 

58 

109 

fair;  impartial 

c.  gives  effective  instructions 

59 

110 

6. 

Personal  conduct 

a.  trustworthy;  personal  integrity;  high  morals;  conduct  above 

60 

ill 

reproach 

b.  dependable;  reliable;  has  high  standards 

61 

112 

c.  ambition;  motivated  to  get  ahead 

62 

113 

d,  loyal;  supports  superiors'  goals 

63 

114 

e.  conscientious;  dedicated;  serious-minded 

64 

115 

f,  career-minded;  devoted  to  AF 

65 

116 

7. 

Personality  attributes 

a.  guiet;  mild-mannered;  unassuming;  modest 

66 

117 

b.  has  positive  effect  on  others  (including  subordinates): 

67 

118 

inspires  confidence;  obtains  respect,  support,  cooperation; 
is  liked  or  admired;  creates  favorable  impression  of  self 
and  AF 

c,  mature;  emotionally  stable;  self-confident;  works  well  under 

68 

119 

stress;  self-discipline;  adaptable 
d.  conforms  to  AF  mores;  military  bearing,  appearance  or  manner; 

69 

120 

maintains  physical  condition 
e.  sense  of  humor 

70 

121 

f.  friendly;  cheerful;  agreeable;  pleasant  or  pleasing  personality; 

71 

122 

likes  people;  gregarious;  congenial;  generally  gets  along  well 
with  others 

q.  considerate  of  othors;  tactful  and  courteous;  respectful;  ex¬ 

(Card  3) 

1 

123 

emplary  social  conduct;  ''gentleman";  dignified 
h.  understanding  of  others;  patient;  tolerant 

2 

124 

i.  strong;  outspoken;  aggressive,  courage  of  convictions 

3 

125 

0. 

Results  or  anticipated  results  of  efforts 
a,  effective  or  improved  unit  or  program  (not  specified  further) 

4 

126 

b.  improved  technical  operations 

5 

127 

c.  monetary  savings 

6 

128 

d,  improved  personnel  utilization  or  training  efficiency 

7 

129 

e.  improved  attitude  or  appearance  of  unit;  morale;  esprit  de  corps 

8 

130 

f.  unit  or  personal  commendation;  has  favorable  reputation 

9 

131 

g.  unspecified  effective  results 

10 

Whore  tv/o  nnml.Mnj  arc  indicah.d,  the  fina  numhoi  rofon'.  to  concrete  exampleu  of  the 
allribnlf?,  u;i  dir.linct  tujn.  more  qenerul  ulatemont!;. 
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Content  Analysis  Categories  (Continued) 


Variable 

Number 

Category 

Card 

Column 

9. 

Knowledge  and  experience 

(Card  3) 

132 

a. 

technical  knowledge  of  field 

11 

133 

b. 

experience  or  background  in  field 

12 

134 

c. 

''well-qualified''  for  job;  versatile;  shows  improvement 

13 

135 

d. 

knowledge  of  related  areas  (e.g.,  management) 

14 

136 

10. 

e. 

interest  in  field 

Performance  evaluation 

15 

137 

a. 

supervision  required 

1  -  extensive;  a  great  deal 

16 

2  “  moderate  amount;  ''some'^ 

3  -  no  mention 

4  -  little;  occasional;  minimal;  limited 

5  -  none 

138  b.  global  evaluation  (of  man  or  job  done)  17 

1  -  satisfactory  in  .routine  aspects 

2  -  satisfactory;  competent;  capable;  efficient;  effective;  fine 

3  “  very  satisfactory;  very  competent;  very  capable;  very 

efficient;  very  effective;  very  fine 

4  "  no  mention 

5  -  outstanding;  superior;  excellent 

6  -  very  outstanding;  very  superior;  most  excellent;  would 

continue  to  serve  with  him 

7  -  most  outstanding  officer  seen  in  10  years,  etc. 

139  c.  global  evaluation  of  temporary  higher  duty  18 

1  -  no  mention 

2  -  satisfactory  in  routine  aspects 

3  -  satisfactory;  competent;  capable;  efficient; 

effective;  fine 

4  -  very  satisfactory;  very  competent;  very  capable;  very 

efficient;  very  effective;  very  fine 

5  -  outstanding;  superior;  excellent 

6  -  very  outstanding;  very  superior;  most  excellent;  would 

continue  to  serve  with  him 

7  -  most  outstanding  officer  seen  in  10  years,  etc. 

11.  Potentiol 

140  a.  capable  of  increased  responsibility;  has  potential  19 

141  b.  should  be  promoted  20 

1  -  negative  statement 

2  -  no  mention 

3  -  with  contemporaries;  qualified  for  higher  grade;  promote 

at  next  cycle 

4  -  ahead  of  contemporaries;  exceptionally  well  qualified  for 

higher  grade;  promote  immediately 
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Variable 

Number 


142 


143 


144 


145 


146 


Content  Analysis  Categories  (Continued) 
Category 


12.  Suggested  assignments 

a.  remain  in  same  or  similar  specialty 

1  -  negative  statement 

2  no  mention 

3  '  on  the  same  level:  mild  recommendation 

4  -  on  the  same  level:  strong  recommendation 

5  ~  on  a  somewhat  higher  level:  mild  recommendation 

6  '  on  a  somewhat  higher  level:  strong  recommendation 

7  ~  on  a  much  higher  level:  mild  recommendation 

8  ~  on  a  much  higher  level:  strong  recommendation 

b.  staff  position 

C-E  R  &  D 


1  -  no  mention 

2  ~  wing  or  division  level: 

mild  recommendation 

3  -  wing  or  division  level: 

strong  recommendation 

4  -  numbered  AF,  major  air 

command  or  higher 
level:  mild  recomm. 

5  -  numbered  AF,  major 

air  command  or  higher 
level:  strong  recomm. 


C-E 


1  -  no  mention 

2  -  below  division  level: 

mild  recommendation 

3  -  below  division  level: 

strong  recommendation 

4  -  division  level:  mild  recomm. 

5  -  division  level:  strong  recomm. 

6  -  ARDC  Center  or  Hqs.:  mild 

recommendation 

7  -  ARDC  Center  or  Hqs.:  strong 

recommendation 

8  -  Hq  USAF  or  DOD:  mild  recomm. 

9  “  Hq  USAF  or  DOD:  strong  recomm. 

R  &  D 


cf  command  position 

1  -  no  mention 

2  -  detachment  level: 

mild  recommendation 

3  “  detachment  level: 

strong  recommendation 

4  -  squadron  level:  mild  recomm. 

5  -  squadron  level:  strong  recomm. 

6  -  higher  than  squadron  level: 

mild  recommendation 

7  -  higher  than  squadron  level: 

strong  recommendation 

d.  other  assignments  (outside  of  career  field) 

1  -  no  mention 

2  “  mild  recommendation 

3  -  strong  recommendation 

e.  professional  schooling 

1  -  no  mention 

2  -  squadron  officer  course 

3  -  command  and  staff  school;  staff  officer  course 

4  -  higher  than  staff  officer  level 


teaching  or  specific  research 

1  -  no  mention 

2  “  mild  recommendation 

3  **  strong  recommendation 


Card 

Column 

(Card  3) 

21 


22 


23 


24 

25 
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Content  Analysis  Categories  (Continued) 


Variable 

Number  Category 


147 


148 

149 

150 


151 


152 


153 


154 


f.  technical  schooling 

1  -  for  remedial  purposes 

2  -  no  mention 

3  -  for  other  purposes 

13.  Formal  educational  improvement  acts 

a.  taking  courses  for  credit 

1  -  no  mention 

2  -  positive  statement 

b.  taking  military  duty  courses 

1  -  no  mention 

2  -  positive  statement 

c.  potential  or  plans  for  educational  improvement 

1  -  negative  statement 

2  -  no  mention 

3  -  positive  statement 

14.  Informal  improvements  acts 

a.  studies;  participates  in  professional  organizations;  attends 
training  sessions 

1  -  negative  statement 

2  '  no  mention 

3  -  positive  statement 

b.  job-related  hobbies 

1  -  no  mention 

2  -  positive  statement 

15.  Civic  responsibility  activities 

1  -  no  mention 

2  -  routine  activities 

3  -  outstanding  activities  or  accomplishments 

16.  Interest  in  flying 

1  -  negative  statement 

2  -  no  mention 

3  -  positive  statement  concerning  interest 

4  -  positive  statement  concerning  proficiency 


Card 

Column 

(Card  3) 
26 


27 

28 

29 


30 


31 

32 


33 


36 


APPENDIX  III:  RESPONSIBILITY  LEVEL  CODES 


Codes  for  Communications  Officers,  Assignments  in  30XX 


1  -  Asst  Message  Center  Off 

Asst  Comm  Center  Off,  Sqd 

2  -  Asst  S-4  Off,  Sqd 

Asst  Comm  Off,  Sqd 
Asst  Ops  Off,  Sqd 
Radio  Off,  Sqd 
Asst  Electronics  Off,  Sqd 
OIC,  Vault  Section 

3  -  Comm  Off,  Sqd  or  Branch 


Asst  Radio  Off 

Message  Center  Off,  Sqd 
Comm  Center  Off,  Sqd 
Comm  Off,  below  Sqd  level, 
except  USAFSS  Det 
Base  Telephone  Off 

Wea  &  P/P  Duty  Off,  Sqd 


Electronics  Offj  Sqd  (ECM  Off) 
Radar  Off  (Sage),  Div 
Maintenance  Off,  Sqd 
Comm  Center  Off,  Grp  or  Wg 
Crypto  Off,  Sqd 
C  0,  Det,  Comm  Sqd 
C  O,  Det,  I&M  Sqd 
Advisor,  Comm  Sqd  (ANG) 

(OIC  Comm  &  Elect,  Sqd) 

Acft  Warning  Off,  AC&W  Sqd 
Wire  Off,  Sqd 
Controller,  Comm  Sqd 
Technical  Services  Off 

4  -  Comm  Off,  Wg  (Hq),  Grp,  or  Base 

Crypto  Off,  Wg  or  Grp 
Asst  Chief,  Div,  Area  Maint  Grp 
Maint  Off,  Wg  or  Grp 
Commanding  Off,  Comm  Sqd 
C&E  Staff  Off,  Sqd 
Asst  C  &  E  Staff  Off,  Wg 
Branch  Chief 
C&E  Trng  Off,  Wg 

5  -  C-E  Staff  Off,  Wg  Hq  (or  Grp) 

Asst  Comm  Off,  Div,  Theatre  Hqs 
Chief,  Comm  Div,  GEEIA  Reg  Hqs 
Inspector  Gen,  GEEIA  Reg  Hqs 
Plans  &  Prog  Off,  AACS  Reg 

6  -  Comm  Off,  Div,  Theatre  Hqs 

7  -  C-E  Staff  Off,  Div,  Theatre  Hqs 


Ops  Off,  Sqd 

Stratcom  Center,  AACS  Sqd 
Comm  Off,  USAFSS  Det 
Radio  Off,  Grp,  Wg,  or  Base 
Asst  Base  Comm  Off,  Grp  or  Wg 
Tel  (Sc  Tel  Off,  TT  Wg  or  Grp 
Maint  &  Sup  Off,  Sqd 
Asst  0/C  AC&W  Site 
Tng  Off,  Sqd 
Msg  Cent  Off,  Grp 
Conelrad  Off,  Div 
Special  Proj  Off,  Sqd 
Signal  Officer,  Sqd 

Sqd  Cmdr,  1  &  M  Sqd 

Chief,  Comm  Serv  Br 

Grd  Elect  Off,  Grp 

Tech  Inspector,  Grp 

Plans  &  Pol  Off,  PCSP  Br 

OIC  or  Commander  of  AC&W  Site 

Special  Projects  Off,  Div 

Comm  Adv  to  foreign  AF 

Wire  Off,  Grp 

Chief  Tng  Div 
Radio  Off,  Reg  Hqs 
Wire  Off,  Reg  Hqs 
Chief  of  Inspection,  Wg 
Dir  of  Comm,  AACS  Reg 

Plans  &  Prog  Off,  Theatre  Hqs 
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Codes  for  R  &  D  Officers 


1  -  Asst  Chief,  Unit 

2  -  Asst  Proj  Engineer 

Asst  Proj  Officer 
Instructor 

Asst  Research  Officer 
Asst  Section  Chief 

3  “  Project  Officer 

Project  Engr  or  Resch  Engr 
Aero  Engr;  mech,  elect 
Asst  Professor 
Staff  Asst  or  Staff  Off 
Resch  Off;  math,  chem,  psych 
Flight  Test  Engr  or  Off 
R  &  D  Administrator 
Chief  of  a  Test  Facility 
Ord  Exchange  Off 
R  <S  D  Off,  Div 

4  -  Chief  Field  Rep 

Chief  Liaison  Off 
Asst  Chief,  Br  or  Div 
Special  Proj  Off  or  Spec  Asst 
Assoc  Prof  or  Prof 
Asst  Exec  Off,  DC/Ws 
Senior  Proj  Engr  or  Off 

5  -  Lao  Chief 

Plans  Off 


Asst  Chief,  Launch  Site 

Unit  Chief 
Chief,  Admin  Office 
OIC  Research  Services 
Chief,  Launch  Site 
Chief,  Tech  Library 

Field  Rep  or  Liaison  Officer 

Section  Chief 

Analyst 

Evaluation  Officer 

Chief,  Plans  Office  (under  a  Div) 

Duty  Classified,  Sqd 

Computer  Prog  Off 

ATILO 

Asst  Task  Scientist 

Asst  Prog  Director 

Computer  Operations  Supervisor 

Chief  Test  Pilot 
R  5t  D  Inspector 
Program  Director 
Task  Scientist 
Chief  Analyst 
Scientific  Advisor 
Planner 

Br  or  Div  Chief 
Chief,  Projects  Off 
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APPENDIX  IV 
VALIDITY  TABULATIONS 
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TABLE  10.  Validities  and  Direction  of  Weights  for  All  Variables  (OER  criterion) 


Rating/fl^^ng 
Jet  qualific; 


Table  10  {Continued) 


42 


last  page  of  table  for  key. 


43 


See  last  page  of  table  for  Icey,  *  X  indicates  score  for  concrete  examples  of  the  attribute. 


Table  10  {Continued) 


44 


last  page  of  table  for  key 


Table  10  (Continued) 


45 


46 


See  last  page  or  table  for  key 
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See  last  page  of  table  for  key, 
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TABLE  11.  Validities  for  All  Variables 


OER  Rating  (Var.  ^lO) 

Active  Duty  Status  (Var.  155) 

VARIABLE 

MTRIX  1 

MATRIX  2 

MATRIX  1 

MTRIX  3 

RVTRIX  2 

No. 

Name 

C-E 

N=1205 

R&D 

N=1812 

C-E 

N=1205 

RM) 

N=1812 

1 

Months  in  active  commissioned 
service 

.1177 

.2961 

-.3331 

-.6989 

-.6989 

2 

Break  in  active  commissioned 
service 

.0224 

.1098 

-.1040 

-.3466 

- • 3k66 

3 

Source  of  Commission 

.1378 

.2944 

-.2616 

.6167 

-.5541 

k 

Relative  speed  of  promotion 

.0454 

.1958 

-.0521 

.4300 

-.4223 

5 

Months  in  grade 

.0608 

.1648 

-.2306 

-.4438 

-.4438 

6 

Months  overseas  as  an  Officer 

.0642 

.1741 

-.2469 

-.4810 

-.4810 

7 

Overseas  service  as  an 

Officer 

.0245 

.1794 

-.2844 

-.5348 

-.5348 

8 

ftonths  in  field 

.1152 

.1171 

-.3021 

-.2882 

-.2882 

9 

Duty  not  in  primary  field 

.0116 

.0728 

-.0717 

-.1472 

-.1472 

10 

Number  of  /iFSC's  held 

.0861 

.1979 

-.1161 

-.5071 

-.5071 

11 

Number  of  Assignments  in  field  .0644 

.1761 

-.304o 

-.4234 

-.4234 

12 

Average  responsibility  level 

.1075 

.0910 

-.1869 

-.0810 

-.0810 

13 

Combat  experience 

.0236 

.l46l 

-.1655 

-.3899 

-.3899 

Ik 

Highest  enlisted  Rank 

.1016 

.1245 

-.1311 

.3736 

-.3447 

15 

No  enlisted  service 

-.o4io 

-.1105 

.2007 

.3725 

.3725 

i6 

Component-Regular  Officer 

.1922 

.3441 

-.l4l6 

-.6377 

-6377 

17 

Component-Reserve  Officer 

-.1922 

-.3441 

.l4l8 

.6377 

.6377 

18 

Number  of  service  school 
courses 

.0902 

.2292 

-.2761 

-.5682 

-.5682 

19 

Highest  career  school 

.0639 

.1617 

-.0715 

.3909 

-.3798 

20 

Level  of  education 

.1015 

.1521 

-.1791 

.2731 

-.1488 

21 

Major  academic  field 

.1757 

.1961 

-.1218 

.2971 

-.1559 

22 

Rating/f lying  status/  Jet 
qualification 

.0439 

.2128 

-.0745 

.4828 

-.4355 
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Table  11  (Continuec/) 


No.  Name 

C-R 

N=1205 

R2:D 

N=1812 

C-E 

N=1205 

RSsD 

N=1812 

23  Total  fiyiiiG  hours 

.0251 

.1815 

-.1203 

- . 4084 

-.4084 

24  Ai^e  in  years 

.0840 

.2209 

-.3338 

- . 6l64 

-.6164 

25  Grade 

.1172 

.3125 

-.3500 

.7515 

-.7294 

26  Security  clearance  level 

.0945 

.2284 

-.1324 

.  3971 

-.3921 

27  Marital  status 

.  1462 

.  1642 

-.2939 

.3787 

-.3763 

28  Religion 

.o4o4 

.1312 

.0012 

.2197 

-.1824 

29  Race 

.1012 

.oiK:7 

-.0462 

.0431 

.0181 

30  Career  preference 

.0852 

.1870 

-.1492 

.5385 

-.5275 

31  Coimnand  preference 

.0610 

.1338 

-.0940 

.  3896 

-.3824 

32  School  pieference 

.0916 

.1913 

-.3516 

.5277 

-.4932 

33  Next  assignment  preference 

.0590 

.1749 

-.2294 

•  5414 

-.5388 

34  Av/ards  (dated  1952  2:  later) 

.2504 

.3260 

- . 8427 

.9973 

-.9444 

35  Coded  duty 

.1030 

.1581 

-.0718 

.3127 

-.2768 

36  Command  (ORR) 

.2072 

.1480 

.0059 

.1784 

-.1386 

37  Civilian  rater 

.0067 

-.1653 

.0007 

.3301 

.3301 

38  Rater  grade 

.2065 

.2378 

-.2191 

.3809 

-.3609 

39  Relative  level  of  I’ater 

.1318 

.1536 

.0141 

.4467 

-.4048 

40  Overall  effectiveness^  ORR 
(criterion  score) 

1.0000 

1.0000 

-.2112 

-.3080 

-.3080 

4l  SuD scale  1  -  Job  knowledge 

.7719 

.7585 

-.1959 

.2114 

-.2047 

42  Sub scale  2  -  Cooperation 

.7304 

.7072 

-.1773 

.2565 

-.2557 

43  Sub scale  3  -  Judgement 

.8615 

.8105 

-.1879 

.2420 

-.2321 

44  Subscale  4  -  l^anagement 
Qualities 

.8157 

.7656 

-.2291 

.3146 

-.3083 

45  Subscales  5  -  Leadership 

.8556 

.8089 

-.1898 

.3031 

-.2931 

46  Subscale  6  -  Communication 
facility 

•  7463 

.6571 

-.1448 

•  3876 

-.2178 

47  Subscale  7  -  Promotional 
Potential 

.9090 

.8831 

-.1728 

.2865 

-.2653 

50 


Table  11  (Conlinuet/) 


No. 

Name 

C-E 

N=1205 

RSsD 

N=1812 

C-E 

N=1205 

R8J) 

N=1812 

48 

Nimber  of  additional 
factors  rated 

.1521 

.  1643 

-.0498 

-.1267 

-.1267 

49 

Unique  factor  rated 

.0494 

.1173 

-.0335 

-.0539 

-.0539 

50 

Responsibility  score 

.2465 

.1758 

-.0784 

.1106 

-.0929 

51 

Initiative  score 

.4092 

.3072 

-.0571 

.1278 

-.1147 

52 

Adaptability  score 

.3013 

.1415 

-.0586 

.0855 

-.0687 

53 

Creativity  score 

.0871 

.0921 

-.0550 

.0201 

-.0194 

54 

Reaction  to  stress  score 

.1458 

.0691 

.0013 

.0631 

-.0347 

5^5 

Responsibility  not  rated 

-.0684 

-.0484 

.0255 

.0767 

.0767 

56 

Initiative  not  rated 

-.1490. 

-.1250 

.0758 

.0918 

.0918 

57 

Adaptability  not  rated 

-.1413 

-.0585 

.0566 

.0698 

.0698 

58 

Creativity  not  rated 

-.0293 

-.0828 

-.0382 

.0144 

.0144 

59 

Reaction  to  stress  not  rated 

.0045 

-.0479 

.0373 

.0567 

.0567 

60 

Length  of  Section  V 

.3628 

.  4i49 

-.1508 

-.3160 

-.3160 

6l 

Number  of  scorable  units  of 
information 

.32)+0 

.3755 

-.01(69 

-.2403 

-.2403 

62 

Number  of  examples  of  effective 
performance 

.2728 

.2270 

-.1198 

-.1166 

-.1166 

63 

Number  of  examples  ineffective 
performance 

-.2695 

-.1916 

-.0150 

.0133 

.0133 

64 

Number  of  information  units  in¬ 
volving  ineffectiveness 

-.1(614 

-.4760 

.1164 

.1364 

.1364 

65 

Analyst's  Rating  of  rater 

.7739 

.7462 

-.1635 

-.1961 

-.1961 

66 

Analytical  1  a 

.1588 

.1582 

-.0476 

.0719 

-.0364 

67 

Direct  x  bx 

.1889 

.1705 

-.0337 

.0496 

-.0087 

68 

Direct  b 

.2653 

.2238 

-.0279 

.0870 

-.0463 

69 

Methodical  x  cx 

.1897 

.1541 

.0018 

.0959 

-.0563 

70 

Methodical  c 

.2509 

.1208 

-.1168 

.0789 

-.0721 

71 

Initiative  x  dx 

.1488 

.1382 

-.0272 

.0927 

-.0821 
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Table  11  (Continued) 


^■Jo. 

Name 

C-E 

N=1205 

R5D 

N=l8l2 

C-E 

N=1205 

R&D 

N=1812 

72 

Initiative 

d 

.27)1-6 

.2536 

-.0626 

.1300 

-.1131 

73 

Jundsmcnt 

e 

.2168 

.1502 

-.02)1-5 

.04-08 

-.0169 

74 

Keen 

f 

.0925 

.0(^5 

.0212 

.0328 

-.0059 

75 

Apply  Knovrledce 

.1190 

,0436 

-.0327 

.0625 

-.0514 

76 

Apply  laiowledce 

G 

.1803 

.  12l|-2 

-.0751 

.09)1-2 

-.0564 

77 

Decisive 

h 

.19)1-4 

.2193 

-.0339 

.0794 

-.0588 

70 

Meets  roq  X 

.  ix 

.1909 

.1292 

-.0776 

.0365 

-.0115 

79 

Meets  req 

i 

•  I97O 

.1555 

-.1550 

.  1105 

-.0800 

80 

Sound  X  2 

ax 

,1079 

.1104 

-.0559 

.0601 

-.0)1-80 

8l 

Sound 

a 

.20)^9 

.2225 

-.o)9-i-i 

.1261 

-.1182 

82 

Creative  x 

bx 

.1606 

.07IH 

-.ol^0o 

.0340 

-.0050 

83 

Creative 

b 

.1740 

.1398 

-.0065 

.0459 

-.0241 

84 

Drive  x  3 

ax 

.1184 

.ll^85 

-.0106 

.0800 

-.0571 

85 

Drive 

a 

.2342 

.2471 

-.0)175 

.1175 

.r.0911 

06 

Dete  mi  nation  x 

bx 

.0742 

.O8I17 

-.0199 

.0937 

-.0463 

07 

Determination 

b 

.1453 

.1720 

-.0961 

.1338 

-.0450 

08 

Task  oriented  x 

cx 

.0765 

.0996 

-.0128 

.0670 

-.0503 

09 

Task  oriented 

c 

.1734 

.1953. 

-.0617 

.1366 

-.-1139 

90 

Accepts  resp.  x 

.0609 

.0326 

-.023C 

.0730 

-.0530 

91 

Accepts  resp. 

d 

.1954 

.2130 

-.1500 

.1309 

-.06)6 

92 

Cooperative  x 

ex 

.190)1- 

.0876 

-.0)1-96 

.0)t95 

-.0242 

93 

Cooperative 

e 

.1622 

.1714 

-.0790 

.0899 

-.0532 

94 

Plans  X  4 

ax 

.2950 

.  I)i66 

-.0'^09 

.07)1-4 

-.0333 

95 

Plans 

a 

.-1235 

.1301 

- . 0028 

.0594 

-.0430 
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Table  11  (Continued) 


No. 

Name 

C-E 

N=rl205 

R&D 

I'I=l8l2 

C-E 

N=1205 

R&D 

Nal8l2 

96 

Written  Comm,  x 

bx 

.0942 

.1298 

.0019 

.0803 

-.0)416 

97 

V/rittcn  comm. 

b 

.  1766 

•1379 

-.0282 

.0553 

-.0303 

98 

Oral  coinm.  x 

cx 

.2048 

.1589 

-.0322 

.1112 

-.0778 

99 

Oral  comm. 

c 

.2013 

.2050 

-.o4o7 

.0851 

-.0594 

100 

^lanaf'cmcnt  x 

dx 

.  1944 

.18)43 

-.0892 

.1035 

-.0703 

101 

Mana^jement 

d 

.2)465 

.2)491 

-.0887 

.1541 

-.i4oi 

102 

Coordination  x 

ex 

.2090 

.1203 

-.0826 

.1019 

-.0887 

103 

Coordination 

e 

.1345 

.1364 

.0150 

.0961 

-.081)4 

io4 

Analysis  x 

fx 

.1)^44 

.  1281 

.00)43 

.0618 

-.0258 

105 

Analysis 

f 

.  1)447 

.12O2 

-.0659 

.0572 

-.0019 

io6 

Leadership  x  5 

ax 

.2159 

.1165 

-.0239 

.0860 

-.0645 

107 

Leadership 

a 

.2513 

.2615 

-.0629 

.1072 

-.08)48 

108 

Personal  interest 

b 

.2010 

.0671 

-.0717 

.0969 

-.0864 

109 

Instructions 

c 

.0762 

•  0675 

-.0173 

.0648 

-.0374 

110 

Trustworthy  6 

a 

.1038 

.1)426 

-.1268 

.0617 

-.0365 

111 

Dependable 

b 

.206)4 

.1138 

-.0938 

.0935 

-.0833 

112 

Ambition 

c 

.1009 

.11)47 

.0086 

.0604 

-.0467 

113 

Loyal 

d 

.1599 

.1861 

-.1103 

.1221 

-.0640 

114 

Conscientious 

0 

.11)4)4 

.0923 

-.0282 

.0686 

-.0601 

115 

Career  minded 

f 

.1376 

.1517 

-.0)475 

.1778 

-.1466 

116 

Q.uiet  7 

a 

.0)16)4 

.0)497 

.0696 

.0647 

.0054 

117 

Positive  effect 

b 

.3085 

.2620 

-.0)461 

•1319 

-.1160 

110 

Mature 

c 

.3309 

.2126 

-.1260 

.12)40 

-.1046 

110 

Coaforrac  bo  AF 

d 

.1749 

.13)19 

-.0378 

.1050 

-.0290 

120 

OenrjL'  of  humor 

rj 

.0)4)42 

.  0883 

-.0G39 

.0448 

-.0313 

121 

Friendly 

r 

.1573 

.  06o2 

-.0553 

.0534 

-.0199 

Table  11  (ContinuecO 


C-E  R2cD  C-E  RSJ) 


No. 

Name 

N=1205 

N=1812 

N=1205 

N=l8l2 

122 

Considerate 

G 

.2204 

.1528 

-.0759 

.0625 

-.0383 

123 

Understanding 

h 

.0941 

.0855 

.0288 

,1056 

-.0870 

124 

Strong 

i 

.2045 

.2228 

- . oo44 

.1139 

-,0991 

125 

Effective  pro^  8 

a 

.2367 

.2171 

.0302 

.1498 

-.1138 

126 

Improved  Tech  ops 

b 

.2259 

.0982 

-.0588 

.0872 

-.0722 

127 

Monetary  savings 

c 

.22S5 

.1058 

-.0323 

.0785 

-.0613 

120 

Personnel  util 

d 

.i860 

.  l484 

-.l4o6 

.1044 

-.0994 

129 

Attitude  of  unit 

e 

.2091 

.1538 

-.1160 

.0651 

-.0601 

130 

Unit  commend 

f 

.2915 

.3117 

-.0428 

.1140 

-.1043 

131 

Unspec.  results 

6 

.1309 

.0966 

-.0797 

.0733 

-.0)1.23 

132 

Tech,  knowledge  9 

a 

.2996 

.2398 

-.0840 

.0822 

-.0546 

133 

E:<perience 

b 

.1877 

.1242 

.0167 

.0878 

-.0513 

134 

VJ  ell-  qua  lif  i  e  d 

c 

.2499 

.2140 

-.0636 

.0593 

-.0299 

135 

Related  areas 

d 

.1652 

•  1636 

.0677 

.1320 

-.0951 

136 

Interest  in  field 

e 

.2066 

.1626 

-.1615 

.0638 

-.0451 

137 

Supervision  req  10 

a 

.  3461 

.2563 

-.1311 

.1136 

-.1014 

138 

Global  eva. 

b 

.4060 

.4115 

-.0501 

.1125 

-.1025 

139 

Temp  duty 

c 

.0532 

.0806 

-.0317 

.0702 

-.0446 

i4o 

Incr.  resp.  11 

a 

•  2955 

•  2301 

-.0405 

.1000 

-.0701 

l4l 

Promoted 

b 

.3577 

,3229 

-.1015 

.1201 

-.0899 

142 

remain  in  assign  12 

a 

,2475 

•  2565 

-.0478 

.1564 

-.1427 

143 

Staff  Position 

b 

.2496 

.1259 

-.1073 

.1587 

-.1413 

l44 

Command/  teaching 

c 

.1453 

.1032 

-.0862 

.0204 

-.0172 

145 

Other  assign. 

d 

.0759 

.0901 

-.1137 

.0909 

-.0260 

146 

Prof •  school 

e 

.0949 

.1632 

-.1283 

.1978 

-,1966 

i47 

Tech,  school 

f 

.0962 

•  0755 

.0228 

.1036 

-.0448 

l48 

Courses  for  creditl3a 

.0543 

,0133 

- .  08)+0 

.0245 

-.0364 
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Table  11  (Continued) 

C-E  R&D  C-E 


No. 

Name 

N=1205 

N=1812 

N:=:1205 

N=:1812 

149 

Mil  courses  b 

.0237 

.0328 

-.0322 

.1914 

-.1756 

150 

Plans  for  ed.  c 

.  0446 

.0581 

-.0137 

.1702 

-.1684 

151 

Studies  l4  a 

.1210 

.1138 

-.0679 

.0610 

-.0392 

152 

Hobbies  b 

.0128 

.0025 

.0145 

.0126 

.0031 

153 

Civic  resp.  15  a 

.0864 

.1312 

-.0352 

.1391 

-.1390 

154 

Interest  inf  lyings  b 

.0331 

.1907 

-.oti6i 

.4035 

-.3987 

155 

Active  duty  status 

-.2112 

-.3080 

1.0000 

1.0000 

1.0000 

156 

2nd  Lieutenant 

0. - 

-.0237 

0 . 

.0367 

.0367 

157 

1st  Lieutenant 

-.1030 

-.3007 

.39^^ 

.7496 

.7496 

158 

Captain 

.0377 

.2116 

-.2841 

-.6245 

-.6245 

159 

Major 

.0730 

.1459 

-.0761 

-.1849 

-.1849 

160 

Lt .  Colonel 

0. — 

0 _ 

0 _ 

0 _ 

0 - 

161 

Major  academic  field  in  En^in-  -.0532 
eering.  Science,  and  Math. 

-.0348 

.0963 

.1162 

.1162 

162 

More  than  2  yrs.  of  college  -.0371 

-.0071 

.08i^4 

.0522 

.0522 

163 

ROTC  Graduate 

-.0920 

-.2264 

.3855 

.5687 

.5687 

164 

Major  academic  field  in 
ness  Adra.  &  I'fenagemcnt 

Busi-  .0128 

.0244 

.0333 

-.0265 

-.0265 

165 

I^jor  academic  field  in 

Liberal  -.0718 

-.0057 

.0450 

-.0939 

-.0939 

Arts 
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APPENDIX  V 

SAMPLE  FREQUENCY  DISTRIEUTIONS 
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TABLE  12.  Distribution  of  OER  Criterion  Scores  by  Sample 


%  of 
Sample 


Overall  Effectiveness 

Communications  Officers 

R  k  D 

Officers 

Score 

Pre  q  • 

A- 

Freq. 

Unsatisfactory  - 

0 

0 

0.0 

.1 

2 

Marginal 

1 

35 

.2 

.2 

4 

Acceptable 

2 

9 

.7 

.11- 

7 

1:5 

1.1 

.7 

13 

Dependable  -  i 

^1- 

58 

3.2 

1.9 

35 

L5 

132 

11.0 

6.4 

116 

r 

231 

19.2 

11.8 

213 

Very  Fine  -  i 

292 

24.2 

22.9 

412 

3557 

29.6 

36.3 

655 

Outstanding 

9 

130 

10.8 

19.2 

346 

Totals 

1205 

100.0 

99-9 

1803 

Mean  OER 

6.91 

7.38 

a 

l.'}-4 

1.37 
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TABLE  16. 

.  Distribution  of  Selected  Background  Variables 
by  Active  Duty  Status  and  by  Sample 

R&D  Orricers  C-E 

orricers 

Active  Duty  Statu 

L> 

Active 

Duty  Status 

(Var  7) 

Overseas  Service 

On  Active 

j  Not  on 

On  Active 

Not  on 

as  an  OTficer 

Duty 

Active  Duty 

Total 

Duty 

Active  Duty 

Total 

Yes 

95.0 

5.0 

100.0 

95.4 

4.6 

100.0 

No 

46.3 

100.0 

70-9 

39.1 

100.0 

71.0 

29.0 

100 . 0 

93.0 

7.0 

100.0 

(Var  11) 

No.  or  Assignments 

in  Field 

1 

76.5 

23.5 

100.0 

57.1 

42 . 9 

100.0 

2 

28.7 

71.3 

100. 0 

38.9 

61.1 

100.0 

5 

53-0 

'1-7.0 

100.0 

50.0 

50.0 

100,0 

4 

65.9 

34.1 

100.0 

69.8 

30.2 

100.0 

5 

80  Ji- 

19.6 

100.0 

81.3 

18.7 

100.0 

6 

87.9 

12.1 

100.0 

90.9 

9.1 

100.0 

7 

96.6 

3.'l- 

100.0 

90.0 

10.0 

100.0 

8 

98.2 

1.8 

100.0 

97.2 

2.8 

100.0 

9 

97.0 

3.0 

100.0 

97.0 

3.0 

100.0 

10 

97-9 

2.1 

100.0 

94.0 

6.0 

100.0 

11 

100.0 

0 

100.0 

100.0 

0 

100.0 

12 

100.0 

0 

100.0 

100.0 

0 

100.0 

13 

100.0 

0 

100.0 

100.0 

Q 

100.0 

71.0 

29.0 

100.0 

93.0 

7.0 

100.0 

(Var  15) 

Enlisted  Service 

Yes 

94-.6 

5.4 

100.0 

96.6 

3.4 

100.0 

No 

41.2 

100.0 

85.6 

14.4 

100.0 

70.9 

29.1 

100.0 

93.0 

7.0 

100.0 

(Var  20) 

Level  or 

Education 

Unkiiov/n 

100.0 

0 

100.0 

66.7 

33.3 

100.0 

1 

100  .0 

0 

100.0 

100.0 

0 

100.0 

2 

100.0 

0 

100.0 

97.0 

3.0 

100.0 

3 

100.0 

0 

100.0 

98.2 

1.8 

100.0 

4 

97.5 

2.5 

100.0 

97.2 

2.8 

100.0 

5 

65.4 

34.6 

3.00.0 

84,6 

15.4 

100.0 

6 

91.2 

8,8 

100.0 

90.0 

10.0 

100.0 

7 

76.8 

23.2 

100.0 

86.7 

13.3 

100.0 

8 

88.9 

11.1 

100.0 

0 

0 

100.0 

9 

81.1 

100.0 

0 

0 

100.0 

71.0 

29.0 

100.0 

93.0 

7.0 

100,0 
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